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ABSTRACT 



Simulated Occupational Choice (SOC) was developed to measure competencies 
In career decisionmaking* SOC Is a structured, Indlvldtially-admlnlstered 
simulation exercise designed to elicit career declslon-maklng behaviors and 
enable those behaviors to be observed, recorded, and scored In meanlnf;ful ways, 
particularly for diagnosis* It was administered durlnf^ three field tests to 
small samples of 9th- and 12th"grade students and later to small numbers of 
collep^e students* It has undergone a series of revisions during Its develop" 
ment and Is still to he consldei^ed an experimental instrument which may (1) 
be administered by couaselors to diagnose a student*? competencies and de- 
flciencles In seeking. Interpreting, and using Information relevant to career 
decision-making^ (2) be used with small samples of students to evaluate a 
guidance program or treatment^ (3) serve as a criterion for validating group- 
administered tests of career decision-making competencies^ and (4) provide the 
nucleus for a group course In career declslon-maklng* 
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CHAPTER I 



THE DEVELOPMEMT OF SOC 

t 

f 



This developmental research began with a perceived need, an 
Idea for meeting that need, and a procedure for translating the Idea 
Into practice* The need was for a good measure of competencies In 
career declslon**maklng (hereafter CDM), particularly a measure that 
would provide diagnostic Information about such essential processes 
as acquiring and using Information* The Idea vas to develop a struc- 
tured and standardl2ed simulation of occupational choice that would 
elicit Important CDM behaviors and enable those behaviors to be ob- 
served, recorded, and scored In meaningful ways* The translation of 
this Idea Into ^ useful product required Initial development followed 
by Iterative cycles of tryout and revision to test and Improve the 
procedures, materials, and scoring system* ^ 

Thus, several successive forms of Simulated Occupational Choice 
(SOC) were constructed and tried out* Although complex behaviors 
were belnf^ elicited, dictates of practicality required (1) simplifi- 
cation of pxTocedures and materials so that the Instrument could be 
given by people with very little training, (2) reduction of adminl^ 
stration time to no more than 45 minutes so that a substantial num^ 
ber of students could be tested, and (3) ease of recording so that ob- 
servations, could be readi^ly entered and later converted Into scores 
that directly describe behavior In diagnostic terms* ^ ^ 

It was originally hoped that we could provide evidence of valid- ^ 
Ity of scores In the two-year term of the project* We. never reached 
this point, because each tryout of materials and procedures gave us 
new Ideas foi; Improvlng—or at least changing— 'the Instrument* Only 
at the end of the period were we satisfied that SOC had reached a 
state of readiness for validation* 

The report, then, deatls mainly with the development of SOC through 
Its successive transformations* Instead of proceeding directly to a 
description of the current version of SOC, as If It were what we had 
had In mind from the very beginning, we have eschewed the advantages 
of hindsight and have tried to describe our trials and errors and ^ 
correctlcms and further errors along the way to our present vantage / 
point* ^ / 

From this vantage point. It Is now clear chat some of the things 
we did were stupid* How could we have expected them to be anything 
but losers? In mitigation, we can say only 'chat wisdom comes from 
good judgment;; good judgment comes from experience; and experience 
comes from ^ad judgment* Thus, In tracing In some detail this devel-* 
opmental effort through Its vicissitudes, we record our own growth 
as competent dedslon^makers* For, as Shaw said, "Men are wise In 
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proportion not to their experience^ but to their capacity for experience*" 
If SOC is nov a promising product^ it is because ve have been able to 
learn from experience — that is, to identify a problem, to invent and con- 
struct solutions, to see information, to select what is relevant, to in- 
terpret it and use it in our judgments, and then to reconstruct our solu- 
tions* 

But this record of the researchers' growth in wisdom during the 
development of SOC, however irresistible it may be to the reader, still 
leaves a gap: evidence bearing on validity. Abhorring this gap, we 
collected and analyzed data generated by administration of the very 
latest form of SOC to another small sample of students enrolled in a 
four-year college* These students included an experimental treatment 
group that had used the computer-based System of Interactive Guidance 
and Information (SIGI) and a control group that vas scheduled for later 
use of SIGI* This study, although undertaken after the expiration of 
the grant period, is described in Chapter V* Although group scores are 
compared, our major f6cus throughout ehis developmental research and o 
formative evaluation has remained consistently on interpretation of in- 
dividual scores for diagnosis of competencies and deficiencies in CDM* 

Rationale for SOC 



Current emphasis on career development and guidance brings renewed 
concern with evaluation and particular focus on the criteria by which 
the effects of such programs can be measured* ^Touching on ^ this problem 
in the Encyclopedia of Educational Research^ th^e present writer pointed 
out, 

"Triennial reviewers have consistently decried 
the scarcity and poor quality. of evaluation 
studies (Jones, 1939; Patterson,' 1963)* The 
criterion problem has been particularly slip- 
pery* Like a fussy fisherman who can't eat 
what he can catch and can't catch what he 
could eat, ^the evaluator has generally found 
that angling for data on long-range outcomes 
overtaxes liis patience and resources, while 
^ the short-term data that are motfe easily net- 

ted often lack nourishment or flavor and may 
as well be thrc'm back*" [Katz, 1969a] 

The article goes on to review criterion measures used over the 
last thirty years, most of which emphasize external judgments of the 
wisdom of choices made* Many of these criteria were appropriate for 
a trait-and- factor theory of guidance, but recent evaluators — recog- 
nizing the impact of contemporary models of career development and 
decision -making — have sought other fish to fry* ^ 

As Cronbach and Gleser [1957] suggest, 

*'**the decision for each [student] must be 
evaluated on a-different scale of values* 
Since the student will make a particular 
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choice only once» It Is manifestly Impos- 
sible to seek a strategy which Is superior 
on the average, for tha average has no mean- 
ingful definition. A particular decision 
must be evaluated on the basis of the ex- 
pected outcome and Its value for this Indi- 
vidual/' 

they conclude that It Is Impossible for anyone save the decision- 
maker himself to determine the "correct'* course of action; 

\ 

*'To correct. [the Individual's] .. .mlscon- 
*ceptlons regarding the probable outcomes of 
various decisions. . .Is just one side of the 
decision process. An equally Important de- 
terminer of the utility of the decision Is 
whether the. .. [Individual] .. .brings to bear 
a consistent and fully acceptable value 
system.'' [ Ibid.] 

Hov does one devise measures of these, highly Individual concepts, 
such as awareness and consistency of values In making a decision? The 
present writer grappled with this problem In the evaluation of the ef- 
fects of a work-text In career decision-making for junior high school 
students [Katz, 1957]. An objective "test was developed^ purporting to 
measure students' mastery of concepts Involved in self^api^ralsal, In 
getting and Interpreting Information, and' In the logic of career de- 
clslon-inaklng [Shlmberg and Katz, 1962]. Although experimental schools 
scored very significantly higher on this test than control schools, the 
author must confess, dissatisfaction vlth the necessary emphasis In such 
a test mainly on students* ability to express their understanding of 
principles and cohcepts-'-albelt sofuetlmes applied to hypothetical cases — 
rather than on their application and use of these understandings and 
, skills In their cnm decision-making. 

As part of the same evaluation study^, Grlbbons vas commissioned to 
develop and use an Interview schedule that attempted to measure the 
students* ability to relate the corCcepts and principles they had learned 
to their am decisions and plans [Grlbbons, I960]. 

Scores on this Instrument (Readiness" for"^)[ocatlonal Planning) 
showed that Experimental students experienced highly ^significant In- 
creases in awareness of their own values. Interests, Sai^l abilities, 
made greater use of these concepts In decisions about their curricula 
and occupations, and evidenced greater willingness to assume responsi- 
bility for their career decisions. In short,.^ese findings were In- ^ 
terpreted as evidence that the experimental group had gained in the 
construct which Super and Overstreet [1960] defined as ^Vocational 
maturity." 



Readiness for Vocational Plannlnf^ has been used In an extensive 
program of research by Grlbbons and Lohnes [19681 • Some of these 
later results have been anomalous » raising serious questions about 
the laeasure as an Index of 'Vocational maturity*" For example* 
eighth-grade scores have been more accurate than tenth'^grade scores 
as predictors of later (post-secondary school) "success of vocational 
adjustment*" 

Ot;her researchers have also developed Instruments that purport 
to measure "vocational maturity*" One of the best known and most 
carefully constructed Is the Vocational Development Inventory [Crltes, 
1971]* The Items In this Instrument (designed for use at elementary 
and secondary school levels) are keyed according to the responses of 
twelfth-grade students* Extensive developmental research has been 
carried out — for example, on elimination of vatlance attributable to 
acquiescent response set* Yet the Instrument has been criticized on 
just these grounds: Vocational maturity, as defined by the VDI, 
means saying no. And a group of counselor educators and vocational 
psychologists disagreed vlth the keys for a number of Items* 

A Career Questionnaire more recently constructed by Super and 
others [1970, 1971] also alms to measure "vocational maturity." The 
three factors most closely Identified vere named Planning Orientation, 
Resources for Exploration, and Decision-Making and Information — ru- 
brics similar to those derived from the Career Pattern Study [Super 
and Overstreet, I960]* Several sets of Items ask students to report 
"how much thinking" they have done on various topics related to career 
choices, hov much "time, thought, and effort they give to making 
choices," how much they feel they kiiow about various aspects of the 
occupation they like best, and what sources of Information they might 
use, or have used; mother set taps^ccupational Information: for ex- 
ample, labor market trends, amount of education required for entry 
Into various ^occupations , equipment used In specified occupations, and 
so on; still another set presents some brief bits of Information about 
a hypothetical student and asks what interpretation should be made or 
w»iHt action the hypothetical student should take* 

Westbrook [1970] had been developing a Vocational Maturity test 
which originally Included a number of items frop the test that Katz 
developed In the 1950'' s, mentioned earlier [Shlmherg & Katz, 1962]* 
The Items In Westbrook's test tapped various kinds of Information, 
Course and Curriculum Selection, Planning, Goal Selection, etc* A 
more recent version appears to concentrate almost excliuslvely on oc- 
cupational Information: duties, work conditions, entry requirements, 
etc* of various occupations* . ^ 

Crltes [1973] has also attempted to develop "competency" tests* 
His battery Includes 20 Items for each of the following tasks: select 
an appraisal of an* Individual from a description of characteristics: 
match'an occupational title to a job description; fit a job to a des- 
cription of some Individual characteristics^ Identify an appropriate 
sequence of steps to enter a given occupation; and recognize a solu- 
tion to a given problem In school or In choosing an occupation* 
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All of these efforts to get at the construct, "vocational matur- 
ity," are good tries. This Is not to damn them with faint praise. 
But It Is to suggest that they are still some distance removed from 
a direct measure of competence In career declslon^maklng (CDM). They 
test occupational Information and understanding of concepts or pro- 
vide self-reports of attitudes, but they do not directly observe the 
student^s behavior In applying hls^ concepts and attlttides to the 
actual process of making decisions. At best, they may be "Indicators*' 
of the construct of "vocational maturity," but they are hardly "de- 
flners'* of It, to use the distinction made by Cronbach [1969], 

Certainly, they seem remote from the complex competencies that 
the Individual student must master and use In his own career decision* 
making. For examp'^.e, matching an occupation title to a job description 
mi^t measure reading comprehension and general Information, but hardly 
seems specifically relevant for CDM, Selecting a job that fits a des- 
cribed set of Individual characteristics In a multiple-choice format 
Implies that there are pat universal answers to CDM — the old and dis- 
credited model of matching an Individual to an occupation on the basis 
of a few traits. These are not work samples of CDM because they do 
not Involve the Individual ^tudent^s own constructs; thev do not en- ^ 
gage him In CDM in his own identity* Yet the unique content of CDM, 
as distinct from the content In other kinds of educational knowledge 
and skills, resides primarily In the Individual student^s sense of his 
own Identity. He must first know himself. Then, when he deals with 
data from other domains— for example, occupations and educations-he 
seeks relevance to the personal domain In .tepis of what Is salient to 
him. He feels no urge to concern himself with the total universe of 
occupational Information, or some random sample of It.' He vants 
deal not with a random but a stratified sample — the strata to be de- 
fined uniquely for him, by himself. He seeks relevance before (to 
use a distinction formulated by Tledeman, 1967) data can become I n - ^ 
formation. In short, the domain of personal constructs and specifi- 
cations must define the relevant slices through the universe of ex- 
ternal domains. 

It may be true that the more students know of the total universe 
of some domain, the more they are likely tq know what is relevant. 
But that Is only to say that cognitive competencies generally tend 
to be Inter correlated. If we are to use such Indicators , we might, 
as well use measures of reading comprehension or mathematical ability 
or general Information.* Such measures are not def Iners of competency 
In CDM, not can they Identify the unique variance In COM. 

To go a step furthet, one may raise questions about their vali- 
dity as "Indicators." For example, the many items getting at facts 
about particular occupations hardly seem appropriate for students 
who may havfe hadno Interest whatsoever in those occupations. Al- 
though some questions refer to occupational preferences expressed by 
the student (for Instance, Super attempts to assess "Wisdom of the 
Occupational Preference" and "Consistency of Preference"), the title 
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of an occupation Is probably, a poor Indicator of what choosing an oc- 
cupation means to Individual* 

As this writer has elaborated elsewhere [Kat2» 1969b]» the con- 
tent of choice id a less defensible criterion than the process of 
choosing* A measure of process also turns out to l)e quite practical* 

Through simulation , It Is possible to standardize the array of 
career options and the universe of Information available about each 
option* We can then focus on each student's behavior in seeking and 
using information to make his choice among the options* As the pres- 
ent writer has pointed out previously, 

*'becls ion-making at each stag^ may be regarded as 
a strategy for acquiring and processing Informa- 
tion* If a decision is truly to be made. If it 
Is not a foregone conclusion, it must Involve some 
novel elements* The person confronted with the 
problem of decision-making either does not Hnow 
what information he needs, does not have what 
information he wants, or cannot use what informa- 
tion he has* Xljus, the pressure for making a 
decision creatW^ a discrepancy between the in- ^ 
'dlvldual*s present state of knowledge (or wisdom) 
and the state that is being demanded , of him," 
[Kat2, 1963, p, 25] 

' It seems reasonable then, as the author suggested in a paper on 
"Criteria for Evaluation of Guidance," that 

"The role of guidance should be to reduce the 
discrepancy between a .student^s untutored readi- 
ness for rational behavior and some hypothetical 
ideal state of knowledge and wisdom* Thus, the 
appropriate criteria for a given program* * *mlght 
be: (1) Do students know what information they 
need? (2) Can they get the information they 
want? (3) Can they use the information they 
have?" [Kat2, 1966, p. 176] 

To know what information he needs > a. st;udent must know his own 
values* If we grant that students %rill vary in the weights they at- 
tach to any occupational value^ we must allov^ for variation in the 
Importance that any item of information will have for- each student* 
Thus^ a student should be free to seek th^ information that is most, 
significant and salient to him at any sta^e in his career decision- 
making* The extent to which he recognizes what information is salient 
will be reflected by the extent to which he asks the "right questions" — 
the questions that will lead him to t^he imjiortant information* 
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To get the ln£onnat:lon he wants Implies not just that he seeks 
^Information from an appropriate domain. He must also know how to 
frame the question so thdt appropriate connections can be made be- 
tween his values and occupational Information that ml^ht be acces- 
slble^ For example^ If a student values job security^ he must be 
able to translate this value Into questions about tenure^ seniority 
provlslors, occupational outlook projected over a period of years, 
vulnerability to economic conditions or to technological develop- 
ments, and so on* He should also be able to recognize the categories 
In which specific Items of Information are most likely to reside^ 

Finally, to use che Information that he receives means that the 
Information makes a noticeable difference In moving toward a decision, - — — 
A student must be able to Integrate pieces of discrete Information In 
some rational way .to arrive at a decision* The Impact of each Item 
of Information on the student^s decision should be visibly consistent 
with the Importance of the dimension to which It pertains and with 
the Instrumentality of each option for providing appropriate rewards 
and satisfactions*^ 

All of these considerations have gone Into the construction of 
the Instrument called Simulated Occupational Choice (SOC)« Like 
simulations generally, SOC presents a standard set of exercises that 
are representative of real-life tasks, but purified and t-lme-compressed^ 
with much of the "noise** and messlness of real-life conditions removed 
or controlled^ It Is an Individually administered procedure which may 

(1) serve as a criterion for validation of group-admlnlstered tests^ 

(2) be used with small samples of students to evaluate a guidance pro- 
gram, (3) be administered by counselors to help diagnose an individual 
student^s strengths and wealcnesses In using and applying Information, 

or (4) provide the nucleus ^.for a group course In career decision-making* 



Schedule-of SOC Research 

Simulated Occupational Choice (SOC) was a two-year project aimed 
at developing an Instrument for measuring competency In career decision- 
makln)^* As Is often the case In developmental work, the Instrument un- 
derwent numerous changes from the original design during the course of 
the project* Three separate field tests were conducted^ one during the 
first year and two during the si^cond^ each with a different version of 
the Instrument and with a different sample of secondary school stu- 
dents* Finally, an additional administration of SOC Involved, a 
small sample of college students, A sketch of the flow of research 
activities Is given In Figure A, 

This report describes each field test separately In chronologi- 
cal order* During the first year we traveled about as far as scheduled 
down the road we had mapped out* If things had gone the way we had 
hoped, by the end of that year we would have found ourselves well along 
in the development of a final version of SOC* But things did not go en- 
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tirely well. The prelimlnarj* versiop of SOC proved to possess many 

useful and Interesting features, but we were dissatisfied with the 

measures and decided that extensive revisions were required* (See Chapter II*) 

These revisicms were made during the second year of the project, 
and two additional field tests were conducted to try out modified 
versions of SOC* The results of these additional field tests are pre- 
sented in Chapters III and IV* A final version, with relatively minor 
revisions, was then used with a small sample of college students, as 
reported in Chapter V* 
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FIGURE A 



SCHEDULE OF SOC RESEARCH 



Field Test 1 

Spring 1974 
Interviews/SOC 

r 

Data Analysis & Revision 

~. i 

Field Test 2 

^^FalTl;974 

Intervlews/SOC 



Data Analysis & Revision 



Field Test 3 
_ Spring 1975 
SOC 



Data Analysis 



Use with College Students 
Fall 1975 



Final Report 
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CHAPTER II 
FIELD TEST 1 (SPRING 1974) 



General Deslt^n 

SOC was administered la conjunction with an Interview previously 
developed to assess CDM competencies and characteristics* Two sepa*- 
rate hours of each student's time were needed to complete participa- 
tion* Half the students played the SQC gome during the first hour; 
half were Interviewed first* A week usually elapsed between the first 
and second parts of the study. Purlng the second hour» students who 
had played SOC first were Interviewed^ and vice versa. To avoid con- 
tomlnatlon^ a student played the gome with one researcher and was In- 
terviewed by another researcher. 

Each student played SOC at least once. If time permitted^ a 
second game (with three new occupations) was played using the same 
questions generated by the student In the first game. Ninth graders 
took from 20 to SO minutes to play one SOC game» slightly longer than 
It took seniors to play one game (from 15 to 40 minutes). Consequently » 
fewer ninth graders played the game twice. 

Description of Sample " — — 

Four area schools agrded to participate In the SOC pilot Study. 
Two schools were four-year schools, from which both freshmen and seniors 
were drawn. One school was a junior high school, from which freshmen 
were drawn. The fourth school, from which seniors were drawn, was a 
senior high school . In the same area as the junior high school. 

Names of thirty ninth-graders and thirty twelfth-graders were 
taken at random from' rosters at each school. Equal numbers of boys 
and girls were selected. Students whose names had been selected were 
Intervlei^d Individually. The project was explained and students were 
told what would be required of them, ^hose who agreed to participate 
were given a letter to their parents explaining the research, and a 
permission slip to be signed and returned. Of the 124 students Ini- 
tially contacted (see Table II^1)> 85 agreed to participate. Of the 85 
who agreed, 73 students completed all parts of tue project. 

The final sample consisted of 39 ninth-graders (18 boys and 21 
girls) and 34 twelfth-graders (19 boys and 15 girls) from the four 
area schools* — 



22 



TABI.E II-l 

f 

DESCRIPTION OF SAMPLE, SPRING 1974 
Grade 9 Grade 12 ' ' Total Gr. 9 & Gr. 12 





No. 

Contacted 


No. 
' Airreed 


No. 

Completed 


No. 

Contacted 


No. 

Agreed 


No. 

Completed 


No. 

Contacted 


No. 

Agreed 


No. 

Completed 


School A 


■ 17 


7 


7 


19 


12 


9 


36 


19 


16 ^ ■ 


School B-1 
Scltool B-2 




26 


24 


• 18 


11 


11 


48 


37 


35 








School C 


20 


11 


8 


20 


18 


14 


40 


29 


22 


Total 


67 


U 


39 


57 


41 


34 


124 


85 


73 
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SOC Procetlures, Spring 1974 

The following Is a description of the SOC game as It was played In 
the first field trial. 

J ' The student received the following Instructions printed on a sheet 

of paper and was permitted approximately five minutes to respond: 

"In a few minutes you will play a 
game designed to measure how good 
a declslon^^aker you are* I will 
ask you to choose one of three oc- 
cupatlons that suits you best* 
These are real occupations^ but I 
' will not tell you their names* 

To help make this choice* you will 
ask quest 1 ons and receive answers 
about the three occupations* 

This Is not a guessing fjame and 
you will only be allowed to ask a 
limited number of questions* You 
should ask only those quesf^ons 
that are Important to help you de- 
cide which occupation Is likely to 
suit you best* 

Spend the next few minutes Jotting 
down questions you would like 
swered* Don't worry about the 
ea^ct wording — what you write now 
will serve as notes for playing 
the game later* 

Use the space below to write your 
questions *" 

A brief description of the game was read to the student; 

"As you already tmow» the purpose 
of the game Is to ask questions so 
that you can choose the one of the 
three occupations that suits you 
best* Each time you ask a question 
and get Information^ you will be 
asked to show how you feel about 
each occupation as an. actual choice 
for yourself by moving markers, 
along a scale*" 
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"Before I tell yoU what the dessetts 
are, I want you to make a choice* 
Which of the three desserts do you 
choose? Now I w^nt you to tell me 
how certain you are of your choice* 
In other words, I want you to esti- 
toate what the chances iiK 100 are 
that even if J told you what the 
three desserts were, desMrt ^ ( top ' ' 
oge)' would be the oner you^would se-' 
lect as your. favorite* Think of it 
as a betting situation' in which you 
have $100 to wager* Right now you 
have only a limited amount of In^ 
formation about the desserts* How • 
much of that $100 would you Tiet that 
when I show you the desserts^you 
will. select dessert ( top One as ^ ' 
^ your favorite one?) (Record*) iJhat 

leaved dollars* How much of ^ 

that would you bet that you would . 
select this dessert as yout favorite? ' 
(Recordi) That. leaves ' dollars 
^ for this last dessert." ' 

Desserts were shown and student wad asked if. his bets seemed to 
reflect the certainty of his choice* ^ 

When it was clear tt\at the student understood ^t^e task, he started 
to play the game* For each of his first five questions, the scale 
positions of the markers were, recorded* After the fifth question, the 
student was asked to make a choice and t*o indicate how certain he was 
of that choice* * 
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"Now we'll go on to play the game* 
In playing the game you will move* 
the markers^ and show how certain 
you are of your chqice , much the 
same as you did for the desserts* 
Instead oi desserts, however, the 
task idll he to select the occu- 
pation that suits you best* Be- 
fore we start, do you have any 
questions? ^ 

Now ask me a question* Rem^^*er, 
tt^ig is not a guessing game * Only 
ask (Questions that will help yoxt 
' decide which occupation suits you 
best* All of these occupations, 
are ones youWe heard of and all , 
requ/te seine training*" 

26 



Up to five student questions were answered. Scale positions were 
recorded after each question. 

"Now^ I want you to make a choice. 
I realize t^at you have only a 
Halted amount of Information 
about these three occupations^ 
but choose one aryway. (Record 
choice.) Now I ;^nt you to In- 
^ dlcate how certain you are of 
your choice^ much In the eame 
way you dldfstn the dessert sit" 
uatlon.^ Ho^ much of the $100 
would yoif bet that even If you 
knew all there was to know about 
these occupations you would 
still select the one you did? 
(Record.) How much would you 
bet on this next occupation? 
, (Record.) The remaining money 
(so that It sums to $100) we* 11 
put on the last alternative." 

If the student tried to assign more than $100 across the three 
altematlrres, It was explained why he couldn't do this. 

Next, the student was allowed to ask additional questions. Marker 
positions were recorded after each question. When the student was 
finished asking qu^stlons^ certainty estimates were obtained. 

"Now I will answer any other ques- 
tions you have. What else would 
you like to know?" 

Remaining questions were answered. Movements were recorded one 
question at a time. Certainty esjilmates ^^fite obtained at end. 

The student was then shown a list of the kinds of Information ava^l 
able about these occupations. He could select the Inf ormatlon\he would 
need to see In order to ntake a final decision. Questions were recorded 
and answered. Marker positions were recorded after he saw each plf^ce of 
Information selected from the list. The student selected th^ occupation 
he believed suited him best. Certainty ^stlmatas were obtained after 
the final choice. 
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" Now I*m going to show you the kinds of 
Information that we have about the oc** 
cupatlons. You can get to see whatever 
y Information you like. Remember, how- 

tfter, that you are being scored on how 
you ask for and u^e Information, so ask 
only for Information you consider Im- 
portant. Is there anything on this 
list that you would like to see?" 

Questions were recorded. Student was given extra Information, 
one question at a time. Ratings were recorded after each additional 
piece of Information. Certainty estimates were ohtad^aed at the end. 

The student was then told the names of the occupations and was 
encouraged to discuss his choice. Relevant coiijments and time were 
recorded. ^ 

If time permitted, the procedure was repeated for three other 
occupations using the same questions generated with the first set of 
occupations. Time was recorded. 

Description of Interview Schedule 

The Interview hour consisted of three parts: the oral interview 
schedule, the written Interview schedule, and the value ratings sheet. 

Each student*s oral Intervlw was^tape recorded. A copy of the 
oral Interview schedule Is attached. (See Appendix A.) A manual for 
scoring the oral Interview was developed. (See Appendix B.) The oral 
Interview took approximately 20 minutes to complete. Ten students 
volunteered to have the oral part of their Interviews videotaped. A 
panel of experts viewed the videotapes and each Independently scored 
the Interview with the use of the scorer's manual to determine scorer 
reliability. (See "Reliability of Scoring the Interview," p. 29.) 
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Next^ each student yas required to complete the written Interview 
schedule without assistance from the Interviewer. (See Appendix C.) 
The written part took approximately 20 to 30 minutes to complete. 

The value ratings sheet comprised the final part of the Interview. 
(See Appendix ^.) This was completed without help from the Interviewer 
In approxlinately 10 minutes. 

All three parts of the Interview took from 45 to 60 minutes. 

After each Interview^ the Interviewer wrote a paragraph about the 
student* s performance and assigned a letter grade to Indicate overall 
Impression of the student's level of career decision-making. 

Students who had not already played the SOC game were Instructed 
to return In a week's time. Those who had completed the SOC game were 
finished with their participation In the project. 

Description of SOC Measures ^> 

The SOC game was separated Into three stages. Stage One consisted 
of the first five questions asked by the student; Stage Two consisted 
of any remaining questions asked by the student; Stage Three consisted 
of Information requested from a list that was shown to the student after 
he finished asking questions on his own. 

Distance measures were computed for each stage. In each case^ the 
distance measure was the sum of distance moved between successive marker 
positions for questions asked during that stage. (e*g*t DIST 1 yas equal 
to the sum of the distances moved for questions one through five.) The 
Initial point for computing the distance measure was taken as the mid- 
point of the scale. 

A certainty measure (CERT) was also computed for each stage. This 
measure was the sum of the squared probabilities obtained from the stu^ 
dent at the end of each stage. 

Desirability sums were computed by multiplying the weights that stur- 
dents gave to ten occupational values by previously established ratings 
assigned to each of the SOC occupations for each of the ten values. 
(See p. 19.) 

Frequency of Selection of Each Occupation In SOC Game* Spring 1974 

All three occupations used In the SOC game were shovm to be of medium 
desirability In a previous study. Based on a small sample of community 
college students^ Retail Store Manager had an overall "desirability sum" 
of 101^ X-Ray Technologist's "desirability sum" was 93^ and Newspaper Re- 
porter's "desirability sum" was 91 (on a scale ranging from 40 to 168). 
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There Is no claim that the sample for the previous study was from 
'the same population as the sample for field test ifl. Nevertheless, the previous 
compute<J "desirability sums" served as a guide In choosing three, occupa-* 
tlons that would permit variation In student preferences* Obviously, 
we wanted to avoid a set of three that Included one universally desir- 
able occupation and/or one universally undesirable occupation. The fact 
that a substantial number of students chose each occupation In SOC demon- 
strates that the set of three occupations used does Indeed fulfill this 
requirement , 

Table II-2 shows the frequency with which all students selected X-^Ray 
Technologist, Retail Store Manager, and Newspaper Reporter at tl^e end 
of the SOC game. 

Retail Store Manager was the occupation most frequently selected by 
all students (42%)* Newspaper Reporter was the next most frequently 
chosen occupation (37%). X-Ray Technologist was selected least fre- 
quently <21X). 

Ninth graders selects*! Retail Store Manager nearly one-half the time 
<49X). Newspaper Reporter was second <303S). ,X-Ray Technologist was se- 
lected least often; only 21% of the ninth graders chose It at the end of 
the SOC game. 



TABLE II-2 

FREQUENCY OF SELECTION OF EACH OCCUPATION IN SOC GAME, SPRING 1974 





X-Ray Technologist 


Retail Store Manager 


Newspaper Reporter 


Grade 9 • 


21% 




1 

30% 




<8) 


(19) , . 


(12) 


Grade 12 


20% 


35% 






<7) 


(12) 


(15) 


Total 


21% 


42% 


37% 




<15) 


<31) 


<27) 



Twelfth graders, in contrast, selected Newspaper Reporter most often 
(44%)* Retail Store Manager ranked second, selected by seniors 35% of 
the time, X-Ray Technologist, once again, was least frequently selected, 
seniors choosing this occupation only 20% of the time* 
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The "Desirability" of Occupati o ns "Chosen" 

Desirability sums Cor each occupation were computed by having each student 
rate the importance of 10 values to him (Values Rating Sheet, see Appendix D). 
A previously established rating for each occupation on each value was then 
multiplied by the weight each value had been given by the student* These 
products were then added to produce a desirability sum for each occupation* 
The higher the sum, the better the fit between the occupation and the student's 
values * 

Differences of less than S points between desirability sums were ignored* 
Thus, a student choosing the occupation X**Ray Technologist with a desirability 
sum of 99 was regarded as having selected an occupation with the highest de- 
sirability sum even if the other two occupations had desirability sums of 100 
and lOl, since the difference between the scores was less than S points. 



On the basis of the weights assigned to the 10 values, a student^s "best" 
occupational choice in the SOC game would be one uhich had the highest desira- 
bility sum for him* 

Table II-3(a) shows, by grade, the percentage of students whose occupational 
choice at the end of the self-generated questions (and before seeing the unso** 
licited information) was an occupation with the highest, second highest, or 
lowest desirability sum. 

In most cases (62%) students chose the occupation which had the highest de- 
sirability sum. Seniors were slightly less likely (59%) to select an occupation 
* tth the highest desirability sum than were freshmen (66%). 

Twenty-eight percent of all students selected an occupation with the second 
highest desirability sumt Seniors did so more often (35^) than did freshmen. 
{21%). 

Ninety percent of all students in the sample selected an occupation with 
either highest or second highest desirability. 

Freshmen were twice as likely (1^^) as seniors (6%) to select an occupation 
with Che lowest desirability sum* 

Table II-3(b) shows, by grade, the percentage of students whose occupational 
choice at the end of the game was an occupation with the highest, second high- 
est, or lowest desirability sum. Overall* the percentage of students i^electing 
an occupation of highest desirability remains the same (62%) as in Table II-3(a). 
However, differences now reversed by grade: at the end of the game, seniors were 
more likely (^7%) to select an occupation of highest desirability than were fresh 
men (56%). 

The overall percentage of students selecting an occupation of second highest 
desirability stayed much the sme\3l%) However* freshmen were more likely 
to select the second highest desirability occupation (36%) than were the 
seniors <27%)* 

1/ 
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TABLE II-3(a) 

FREQUENCY WITH WHICH OCCUPATICMS AT VARIOUS LEVELS OF DESIRABILITY MERE 

CHOSEN AT END OF STAGE 2, SPRING 1974 





Highest 
Desirability 


Second Highest 
Desirability 


Lowest 

Deslrabilicv 


Grade 9 


66% 
(26) 


' 21% . 
(8) 


13% 
(5) 


Grade 12 


59% 

(?.o) 


35% 
02) 


6% 
(2) 


A.U'Studcnts 
(Total) 


62% 
(46) 


28% 
(20) 


10% 
(7) 



TABLE II-3(b) 

FREQUENCY WITH WHICH OCCUPATIONS AT. VARIOUS LEVELS OF DESIRABILITY WERE 

CHOSEN AT END OF STAGE 3, SPRING 1974 





Highest 
Desirability 


Second Kt^hest 
Desirability 


Lowest 

Desirability 


Grric'c 9 


56% 
.(22) 


36% 
(1^0 


8% 

. (3) 


Grcdc 12 


67% 
(23) 


27% 
(S) 


6% 
.(2) 


>U1 Students 
(Tour,!) 


62% 
. («) 


m 

(23) 

> 


7% 
(5) 
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At the end of the game» a slightly smaller percentage of all students (7% 
as opposed to 10% at the end of the self ^-generated questions) selected an occu-* 
patlon with the lowest desirability sum. did so to the same degree 

(6%) at the end of the game as at the end of the self --generated questions* 
Freshmen selected an occupation of Im^est desirability five percent less often 
at the end of the game than at the end of the self-*generated questions* 

We had reasoned that students whose first choice on the SOC scales was the 
occupation with th^ highest desirability sum might be regarded as more competent 
in career decision-making than those i^ose first choice did not have the highest 
desirability sijm. The finding that the 12th-graders were not clearly superior 
to th^ 9th^graders in this respect would call this reasoning into question if 
one were to assume that competency in CDM,measured in this way, was a correlate 
of age or grade. (We did not ourselves make this assumption; we believed, in- 
stead, that CDM competencies are learned, and. may often be no better developed 
by 12th grade than by 9th.) 

Comparlng Types "of Questions Most Prequenty Asked fay Ninth and Twelfth Graders 

Table II-4 shows in rank order the Percentage of questions on various topics 
asked by ninth and twelfth graders. By comparing the two columns we can look 
for differences and similarities in the concerns of ninth and twelfth graders 
as expressed in the playing of the SOC game* 

Questions about ^ork activities, leisure, and salary appear with highest 
frequency in both groups* Ninth graders more frequently asked about education 
and physical surroundings; twelfth graders more frequently about variety and 
field of Interest* 

It is interesting that even though job activities were asked about most fre-* 
quently by both groups, 202 of all the freshmen's questions but only 14% of the 
seniors* questions dealt with Job activities, even though seniors tended to ask 
more questions* Seniors averaged 11,7 questions each ahd freshmen 9*4* Of the 
top three identical concerns, freshmen relied more heavily on questions solici- 
ting information about activities. 

Freshmen were more likely to ask about fringe benefits (rank 7) and dress 
regulations (rank 11,5) than were the seniors (fringe benefits ranked 16 and 
dress ranked 21)* Seniors were more likely to ask about security (rank 8), in- 
dependence (rank 12), personal contact (rank 10) » and location (rank 16) thaa 
were the freshmen (security, rank 11,5; Independence, rank 16,5; and location, 
rank 20*5); 

Were freshmen mucK more concerned about dress required f(ir an occupation 
(frequency 3*5%, rank 11*5) than seniors (frequency^l*2%, rank 21), or did they 
find it harder to formulate questions about more abstract characteristics, like 
Independence? We don*t know to what extent such differences in frequency rep- 
resent differences in Importance attached to a characteristic or differences 
in conceptualization* 

Little difference was observed in the frequency with vhlch ninth and twelfth 
graders asked for information in such areas as co-workers, advancement, helping 
others, outlook, prestige, type of employer, leadership, personal qualifications, 
danger^ or pressure* 

33 



-22- 
TABLE I 1-4 

RANK ORDER AND FREQUENCY OF TOPICS ASKED ABOUT 
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Rank (12) 


Rank (9th > 


Topic Grade 12 


1 


1 . 


ACC xvxc xe 9 




2 


2 






3 


3.5 




OA 


4 


6 


Vol xcljt 


1 52 


5 


3.5 


coucacxon 


7T 


— 6 


8 




. 


7 


5 




^ * DA 


8 


11.5 


OCL* U L XC Y 


L 52! 

H • DH 


9 


9 






10 ' 


16.5 


P&vc filial Pnrt f* ^f*^ 


AT 


12 


14 


AQ V an ceinen c 




12 


10 


nuxpxng ucners 


O TV 
J. / A 


12 


16.5 


X LIU C pen U ^ w C 




14 


14 


UUCXOOK 


JL* iA 


16 


7 


Fringe Benefits 


2.5X 


16 


20.5 


Location 


2.5Z 


16 


14 


Prestige 


2.5Z 


18 


18.5 


Type of Employer 


1.7Z 


19.5 


20.5 ' 


Leadership 


1.5Z 


19. 5 


18.5 


Personal Qualifi- 
cations 


1.5% 


21 


11.5 


Dress Regulations 


1.2Z 


22.5 


22.5 


Danger 




22.5- 


22.5 


Pressure 






(■ Total QucstlortS Asked 


399 
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X of Total Questions Asked 

Grade 9 



20Z 

10. 5Z 
8Z \ 
SI 
St' 
4.3X 
6.5Z 
3.5; 
4Z 
2Z 

2.7Z 
3.7% 
2% 

2.7% 
4.6% 
1% 

2.7% 
1.3% 
1% 
; 1.32 

3.5% 
.5% 
.5% 

369 
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Attractiveness of SOC Occupations 

The occupations chosen for SOC were ones that were likely^ on the basis of 
previous research^ to appear equally attractive across students* To corro- 
borate this pointy average attractiveness scale positions were computed for 
each occupa^'lon for each move made In response to an Item of Interest. All 
stud^ts made at least five moves* The number of students asking additional 
questions and making corresponding moves then dropped off steadily with only 
two students making thirteen moves. Table II-5 presents the means and the corre- 
sponding standard deviations of the scale positions of the markers for the 
three occupations after each successive move* 

From this table It can be seen that: 

" All three occupations are of mld~attractlveness '(the midpoint of 
the scale Is 10) • 

- The m^ans for the occupations remain fairly stable across moves* 
This observation Is somewhat less applicable to the meahs for 
Newspaper Reporter^ which tend to Increase gradually across the 
first nine moves* (After move nine thete Is a. sharp decrease 

In the number of students^ thus making the statistics less stable.) 

- Like the means ^ the standard deviations remain fairly constant 
across occupations and moves* This Is somewhat surprising since 
It was anticipated that the three occupations would tend to 
diverge across moves for any one student. This tendency In turn 
would have had the effect of Increasing the variability of an 
occupation across students. Figure B(l) plots the scale movement 
for a student who fulfilled this expectation. But Figure b (2) 
represents the more typical behavior^ In which such positions 
converge* This finding suggests that when choices are difficulty 
between weir~balanced options ^ Increments In information are 
likely to make the subjective desirabilities of the options ap- 
pear closer rather than more distant* 



Means and Intercorrelations of SOC Measures 

Means and standard deviations for SOC measures of distance and certainty^ 
by grade, are presented In TableII-6* There are virtually no differences be- 
tween the grade samrlea on either the distance or certainty measures* 

Also shown in Table II-6 are the mean nimiber of questions asked (Stages One 
and IVo) and the mean number of Itms .selected from the list presented i^n Staj^e 
Three* While the grade 12 mean number of questions asked is higher than the 
grade 9 mean, the difference is not significant* 

The measure Top S represents the number of questions asked in Stage One 
about a student*s five highest rated values* Thlo information was obtained 
from students* ratings of ten occupational values made after completing both 
the game and the interview* The Top S measure also shows no significant group 
difference. 
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TABLE II-5 

AVERAGE ATTRACTIVENESS OF SOC OCCUPATIONS 
(After each move) 



Move No. \ (l) <2) O) <4) <5) <6) <7) <3) <9) <10) <11) -<12) <13) 

X-Ray X' 10.89 10.78 lp.82 11.10 11.31 10.52 10.30 10.31 10.26 10.73 11.27 11.40 13.50 

T*(-hnolDei«t S.D. 3.40 3.35 3.46 3.48 3.54 3.78 3.36 3.27 3.25 3.75 5.06 4.84 2.50 

lecnnoj-ogisc ^ ^ ^ 

i 

Retail Store X 12.12 12.50 li.84 12.51 12.72 12.22 12.14 12.36 12.76 12.05 11.90 12.20 11.00 

Manager S.D. 3.27 2.9 2.74 2.74 2.89 3.68 3.45 3.09 3.19 3.60 4.56 4.26 6.00 

^ N 75 73 7S 73 73 57 49 38 30 19 11 5 2 

_ CO 

Mei/spaper X 11.69 11.66 11.85 12.38 12.81 12.68 13.28 13.57 13.66 13.00 13.81 11.40 10.50 

Re.orcer S.D. 3.01 2.85 2.84 3.70 2.79 3,21 2.35 2.33 2.37 2;00 2.03 2.41 0.50 

N 73 73 73 73 73 57 49, 38 30 19 11 5 2 
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TABLE H-6 



MEANS AND STANDARD DEVIATIONS OF SOC MEASURES, SPRING 1974 





Grade 


: 9 


Grade 12 




X 


S.D. 


X 


S.D. 


Dist I 


1679 


673" 


1676 " 


8.9 


Dist 2 


5.3 


5 7 


6.6 


5,5 


Dist 3 


7.8 


6.8 


'5.3 


4.7 


Cert 1 


.45 


.16 


.46 


.15 


Cert 2 


.55' 


-.36 


.52 


.16 


Cert 3 


.50 


.17 


.54 


.16 


if Questions Asked 


7.3 


2.5 


8.5 


2.0 


^ Questions Stage 3 


3.4 


2.1 


3.1 


2.2 


Top 5 ' 


1.5 


.9 


■\l.6 


.7 



Table II-7 gives the Intercorrelatlons between the SOC measures for 
ninth and twelfth grades combined. From this table it can be seen that; 

- The distance measures are relatively independent of one another 
and of the certainty measures. 

There is a moderate relationship between the certainty measures. 

- There are mo<lera£:e negative relationships between the number 

o£ questions a student asks (Stages One and Two combined) and the 
distance moved in Stage One (DIST 1) and in Stage Three (DIST 3) . 
The high correlations between the ^^mber of questions asked 
and DIST 2 is an artifact of the scoring procedure. 
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TABLE II-7 



INTERCORpUTIONS AMONG SDC MEASURES, SPRING 1974 



<9th and 12th Grades Combined) 



Dlst 1 Dlst 2 Dlst 3 Cert 1 Cert 2 c4rt 3 ^Ques. Asked T-tp 5 




1.00 
.10 
.27 
.21 
.01 
.06 
-.34 
T.IO 



1.0 












-.20 


"1.0 










.07 


.03 


1.0 




















-.02 


:o5 


.30 


1.0 


















-.13 


-.10 


.49 


.35 




1.0 


.67 


-.32 


-.03 


-.07 ^ 


/' 


.04 1.0 


-.19 


-.09 


-i^O 


.19 




.01 ' -.13 



1.0 



Interviev Measures^ Means ^ and Intercorrelations 



Six scores were derived from the oral and written schedules. The item 

composition^ of these scales is as follows <the letter 0 represents an item 

from ttie oral interviews and the letter W represents an item from the written 

interview): ^ V 

. 

Constructs => 01 + 02 + 03 + Oil + 014 
Information = 07 + 010 + W <8-25) + W <26-29) _ 
Reality.^ 04+05 
Planning » 06 + 08 + 09 + W35 
. ^ jConttol - 012 + W <30-34) 
Awareness » 013 + H <36-39) 
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Means and ^standard deviations for the ninth and twelfth grade samples 
on the six interview measures are presented in Table The meait scores for 

twelfth graders are found to be highet on all six measures » with the differ- 
ence between the gratle samples reaching significance for only three of the 
measures (Constructs and Planning at the .01 level; InfoxiDation at the .05 
^ leyel). 



TABLE II-8 

• . 

' - - f -JL'' 

HEMS MD STANDARD DEVIATIONS FOR IKTERVTEW SCALES, SPRINR l$74 



0 , 

9th Grade l2th fir^ de 



**> 


X 


'S.D. / 


* 


X 


S.D. 


V* *^ j 

** Constructs 


9.45 


2;76 




11.47 


3.52 


* Information 


/r.37 


1.55r 




8.15 


1.59 


; - ^ - —Reality-, -^ 


V 1.97 


0.89 ^ ■ 




2.31 


0.85 


** Planning 


2.33 


1.02 




-^-3^77 


1.25 


\/ * . 

Control 


5.49 


1.20 




5.53 


1,58 


"7 Awar^ess « 


10.32 


* * 
2.68 




11.49 


2.50 


* • i 

** Total Oral 


^ 17.85 


4.05 


* 


. 21.86 


4.52' 


» * Total Written 


19.06 


3.98 ■ 




21.08 


3.62 



*,P <' .05 ^-v** p < .01 



4 



Table II-9 gi>'6s correlations ^jsms% the aix interview scales for the 
combined ninth and 6relfth grade samples*. *fhe table shows that the correla-* 
tions are, in general- quite, low^ ^thus indicating that the measures ^are rela- 
, tively independent. Exceptions are the cluster of mof r^te relation4hit>fi in*- 
volving Awareness, Constructs, and Information scales. 
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TABLE n-:9 

'INTERCORRELATIONS BETWEEN INTERVIEW SCALES, SPRING 1974 
^ (9t:h & 12th Grades Combined) 





Const. 


Info. 


Real. 


Flan. 


Cont. 


Aware. 


Constructs 


1.00 












Information 


.39 


1.00 




* 


ft' 




Reality 


.23 


■ .25 


1.00 








% Planning 


.24 


.33 


.09 


1.00 






Control 


.08 


.15 


.24 


.12 


1.00 




^Awareness 


.44. 


.56 


.23 


.15 


.17 




• 

Reliabllltv of 


ScorlnR the 


Interview 











As a check on the i;ellablllty of scoring the oral part .of the inter- 
view » a panel of six judges scored ten videotaped interviews. Prior to 
thft formal scoring, a practice session was held in which two videotapes wer** 
viewed, discussed, and. scored as a group. During this session the scorer^s 
manual was reviewed and disagreements about scoring discussed. By the end 
of the session the Judges were satisfied that they understood the basis 
and mechanics of scoring.* 

t> 

Three of the six ^interview scales (Constructs, Reality, and Planning) 
drew ^st of their items from the oral (as opposed to the written) part 
of the interview. For the sake of this InLer-rater reliability study, 
scores for each of these scales were based only on responses given in the 
oral interview. A total score of all responses in the oral interview was 
also computed. 

Following an analysis of variance [Winer, 1962, Chapter 4], the reliability 
coefficient for a single rating was computed. Table 11-10 gives estimates i 
of the scorer reliabilities for the Constructs, Reality, Planning, and Total 
acales. 
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Scale 

Constructs 
Reality 
Planning 
Total 



TABLE II~10 

SCORER RELUBILITIES 

$ Items 

5 
2 

' 3 
13 
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.77 
.79 
.47 
.83 
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The low scorer rellablllt*y for the Planning scale suggested that it was 
an inappropriate measure and required revision. For example, question 8 o£ 
the interview asked students to name an alternative to .their previously indi- 
cated occupational preference and plans. In response to this question students 
typically name an alternative occupation but did not name alternative plans. 



(Incidentally, it should be pointed out that the Planning scale was 
augmented by an item on the written schedule. Thiswas not considered here, 
since scoring reliability not aniggue for the written responses.) 

One la3t point needs to^be made. The reliabilities presented in TableH^lO 
are scorer reliabilities and not scale reliabilities. Indeed, the scorer 
reliabilities represent an upper bound for the scale reliabilities. No at- 
tempt was made to study the various kinds of scale reliabilities at this 
stage. 

/ 

SOC and Interview Intercorrelations 

If SOC and the interview were measuring the same traits, cie would expect 
the scores to be intercorrelated. In -the course of the research, however, some 
serious shortcomings were noted in the scoring procedures for both instruments/ 
which tended to obfuscate our findings. 

Correlations between SOC and interview scores are presented in Table 11-11* 
The table shows that: 

- With few exceptions, the correlations between SOC and the 
interview scores are low. 

* There is a significant negative relationship between Constructs 
and Dist 1 ( sum of the distances moved fo^r the first five ques- 
tions). This relationship is partly an artifact of the scoring 
procedure. Xh^e initial point from which distance is computed 
(i.e., the impact of the information received in response to 
question one) is the mid-^point of the scale. It muld seem that 
students with few constrlicts at their disposal tend to attach 
heavy importance to their first question. Thus, they initially 
place the markers quite far from the mid^point of the scale. ^ 
Successive distances, which are measured point-t(>^point^ are 
small by comparison and their effect tends to be washed out. 
An obvious means for correcting this problem would be to have the 
student make each move independent of previous moves, and only 
then consider all information cumulatively for .*^he final pjace- 
ment of the markers. A procedure for accomplishing this was 
developed and tried out in field test #2. 
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There Is a significant negative relationship between Constructs 
and Dlst 3 (sum of the distances moved for questions selected 
from the list). This finding Is In keeping with what was hypo- 
, theslzed. It shows that students with many available constructs 
do not tend to attach much importance to unsf^Xlclted information 
presented to them after they have had the opportunity of asking 
their own questions and getting the Information they regard as 
salient. 

i 

TABLE H-11 
CORRKLATIONS BETWEEN SOC AND INTERVIEW 
(9th & 12th grades combined) ^ 

< 





Dl8t 1 


Dlst 2 Dlst 3 


Cert 1 


Cert 2 


Cert 3 . 


il^Ques. Asked 


Top 5 


:>n3truct 


-.37* 


.25 


-.40* 


.00 


-.12 


.13 


.44* 


.05 


[iformatlon 


-.13 


.29 


-.OA 


.13 


.07 


.20 


.35* 


-.09 


eallty 


-.15 


.20 


-.17 


-.11 


.00 


-.07 


.25 _ 


.12 


lannlng 


-.10 


.21 


-.17 


-,18 


.12 


.15 


.26 


.16 


ontrol 


.11 


.02 


.06 


.11 


-.02. 


-.06 


-.13 


.05 


wareness 


-.14 


.07 


-.14 


' .28 


-.05 


.26 


.22 


.03 



P < .01 
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Relative Distance Measures 



As expected, one of the problems we had to deal with was large stylistic 
differences In the use of the response scale, in an attempt to eliminate 
variance attributable to these differences, ratio scores were derived. 

One measure, referred to as adjusted distance (AdJ Dlst), was taken as 
the ratio 'of the original distance measure divided by the total distance 
moved by a student In the pre-game dessert trial. Means and standard devla^ 
tlons for 9th and 12th graders for adjusted distances for Stage One and Stage 
Three, of SOC are: 

9th 12th 



AdjDlstl 
AdJ Dlst 3 



X 


S.D. 


X 




1.65 


1.33 


1.64 


1.19 


.81 


.72 


.56 


.47 



Correlations between adjusted distances, original (distances, and 
Interview scores for grades nine and twelve combined are shown In the Table 
•11-12. 

' TABLE 11-12 

CORRELATIONS BETtmEN ADJUSTED DISTANCE, DISTANCE^ AND INTERVIEW SCORES 

(Grades 9 and 12 Combined) 





AdiDlstl 


Ad.lDlst3 


Dlst 1 


.54 


.24 


Dlst 3 


.14 


.83 


Construct 


-.18 


-.34 


Information 


1 -.05 


-.04 


Reality 


-.08 


-.16 


Planning 


, .11 


.00 


Control 


.01 


-.01 


Awarenes s 


.05 


-.05 



Comparing these correlations with those between the Interview measures 
and DIST 1 and DIST 3 Indicates that the effect of the division by the 
trial distance Is to decrease the Toagnltude of the correlations. 

Another approach to adjusting stylistic variables was to use DIST 1 
as a means for calibrating the scale for dIST; 3 . That Is^ the distance 
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moved In Stage Three of the game relative to that moved In Stage One reflected 
the Impact of unsolicited Information relative to the Impact of Information 
received In response to the first five questions asked. This measure (DIST 3/l) 
Is particularly useful „slnce it not only eliminates stylistic variance but is 
also readily Interpretable in terms of what occurred in the course of the game. 
For example, a large value of DIST 3/1 jmeans that a student failed to freely 
frame questions about factors thatwere (in his own scheme of things) important, 
while the opposite is true for small values of the ratio. Unfortunately, the j 
number of questions asked in Stage Three confounds this measure and it does not 
correlate as highly with the interview measures as the unadjusted distance 
measures. It was clear that procedures for scoring behavior on SOC needed re- 
* examination. 

Other Findings 

The enthusiastic responses and unsolicited comments of both ninth and 
twelfth graders led us to believe that SOC might be effectively used as a 
teaching tool. The SOC game provided the student with an opportunity to par- 
ticipate, frequently for the first time, in a career decision-making situa- 
tion. For the vocationally immature, the game introduced the problems and 
complexities of career choice; for the more vocationally mature, the game pro- 
vided an opportunity to explore the kinds of information that are important to 
career decisions, Students could also analyze their own deficiencies with re- 
gard to information seeking, especially career information. During the field 
test, many students offered comments which demonstrated their confusion and 
lack of information. For example, one articulate senior volunteered, "I sure 
could use some value clarification." And one ninth-grade girl pointed out the 
need for defining the vocabulary of the world of work by commenting upon learn- 
ing that a given occupation required a bachelor's degree for entry, "I guess 
I wouldn't be able to do that—I'm a girl," 

The format of SOC was completely non-threatening since it was a game and 
was viewed as such by the students. It did not communicate a sense of failure 
since there are no right or wrong answrs. However, the students did not parti- 
cipate in an offhand manner. Indeed, just the opposite seems to be the case. 
Students not only got caught up in playing the game, but were stimulated to ask 
questions beyond the actual game situation. 

Briefly, some of the characteristics that would make SOC an ideal 
teaching devide are: 

- Involvement . The game involves active participatici by having 
students think up and phrase questions to be asked, evaluate 
information and move the markers accordingly. And, of course, 
they must ultimately make a decision that seems best to them. 

- Self-Knowledge . In playing SOC students become aware of their 
lack of knowledge about themselves and the world of work. They 
are stimulated to ask a broad array of questions related to 
career choice. 



- Enjoyment . The game format is pleasant and provides a nice change 
from the commonplace teaching techniques of reading, research, 
question answering, paper writing, or lecturing and note-taking. 

- Exploration . It woul^ be possible to use the student's present 
occupational preference as one of the three occupations. The 
students could then see the impact of various kinds of informa- 
tion and notice what things made his occupational choice more de*- 
sirable. . ^ 
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" Relevance . The connection between SOC and a real-life problem 
Is Immediately apparent to students. After the game students 
can seek out the kind of Information they felt was Important to 
them during the SOC game. 



Main Interpretation of Preliminary Results 

During the first year of research we encountered problems of a scope and 
complexity Co Indicate that an extension of the formative stage of study 
would be required. Some of the findings that led us to this conclusion are 
Indicated below: 

^ V- 

Decrease In differentiation . Originally, It was anticipated that as 
students asked questions their options i^uld become more differentiated. An 
example of this behavior was shoxm In Figure B(l), a plot of the scale posi- 
tions for each of the questions asked by student ffXO (p. 23). The vertical 
line represents the end of freely elicited questlohs and the beginning of 
Items selected from ^ list. However, this was not found to be typical be- 
havior. Rather, a gradual decrease In differentiation was typically noted, 
as shown In Figure B(2). 

Looking back, we see that this behavior makes sense. What It suggests 
Is that when students have only one or two Important dimensions In which to 
characterise their options, they can differentiate them well. As more di- 
mensions are added^ they are likely to find conflicting Information about 
each option, which brings the options closer together In attractiveness. 
This reasoning suggests that most Important decisions are difficult Just be*^ 
cause they are between options that are very close j:ogether . 

Decrease In certainty . The certainty measures, which were also expected 
to Increase with the amount of Information received, reflected Instead the 
gradual coming together of the options. For the Grade 9 sample. Information 
pres^ted after students finished phrasing their oxm questions tended to de- 
crease the certainty of their choice. In other words^ the unsolicited In^;^ 

formation made s t ud en t s lesg_c.eiitala> ^ " ^ 



Stylistic differences . One of the lesser problems * but a bothersome 
one nevertheless, concerns the response mode. Large stylistic differences 
In the use of response scales led us to believe that the scales (and possibly 
the task Itself) needed to be more clearly defined. Our original Intention 
of using the pr^-game trial situation as a means for partlalllng out unwanted 
stylistic differences did not seem adequate solution^ This was likely due, 
at least In part, to the dual nature of the pre-game trial Itself. First and 
foremost. It was a learning situation In which the student learned the nature 
of the task and of the scales, not an optimal setting for^deflnlng a response 
mode. 
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Leamlnfi factor ^ Another aspect* of SOp that we had not originally con- 
sidered Is Its built-in Instructional Capacity. Students clearly learn in 
the course of playing the game. The gamers potential as an instructional 
device Is enormous (see page 33)^ but unless this element Is incorporated 
Into our evaluation, It becomes unwanted noise. Further revisions of SOC at- 
tempt"^ to equalize the learning factor by limiting the question-asking part 
of the game and concentrating on the effects of unsolicited information. 

Low SQC/lnterview correlations. The low correlations noted between SOC 
and the Interview measures gave us conslilerable food for thought. While the 
Interview Iteelf needed revision, we had expected to find clearer relatlon*- 
shlfxs between the two sets of measures. Our failure to find them made us 
stop to think — often a valuable activity In developmental research**. 

In rushing to compute correlations between SOC scores and other criteria, 
we had obviously got ahead of our game. We had not given sufficient thought 
to the Implications of each score. Taken by Itself, each score represented 
an operational definition of some construct; but the behaviors themselves 
(and therefore the measures) turned out to be extraordinarily complex, In- 
volving chains of Interaction with other behaviors* 

Here, in a sens^, we lucked out; had the correlations, by some fluke 
of circularity or compensating goofs, been generally significant, we might 
have taken then t^ be evidence of construct validity and never examined more 
closely the wrink3es In the scoring that really had to be ironed out. The 
paucity of significant r^s sent us back to reconsider the scoring rationale — 
the definition of each score, the behaviors on which each was based, the con- 
text of those behavlord, the Intrinsic meaning that might be derived from It. 

The very virtues of simulation — verisimilitude, face validity of tasks, 
free response situations, opportunities for branching as the individual In*- 
teracts w-.th the tasks, and evocation of complex behaviors — make scoring messy. 
We wanted scores that represented behavior as directly as possible, were 
sensitive to Individual differences, and wovld provide diagnostic Information. 
If we could derive scores with such characteristics from s_tudents* behavior 
_ln.^SO.C^ we might be presumed to have a better criterion than anything exter- 
nal to SOC. Then It would be appropriate to see what these scores corre- 
lated with to luok at differences between groups that might be presumed to 
differ In CDM competencies, and to seek other signs of convergent and dis- 
criminant validity. The scoring problenis were really Indicators of pro- 
cedural problems. So for the second year of the project we went back to the 
drawing board and revised the simulation procedures themselves In an effort 
to, produce sounder observations and scores. 

Further Field Tests 



During the second year of the study^ SOC underwent two major revisions^ 
each followed by a field test. In the first of these (Fall 1974), students 
were administered both SOC and an Interview. An analysis of these data In- 
dlcated that SOC needed further revisions. To help formulate appropriate 
changes, a series of In-depth Interviews were conducted In which students 
were queried about their game behavior under varying game conditions. One 
outcome of these Interviews ras a revision of SOC procedures with parti- 
cular concern given to making th^ administration of the game clearer and 
shorter. Also developed waB a new set of diagnostic measures aimed at des- 
cribing the extent to which students were able to get and use appropriate 
klnils of information* 



ERs£C ^'^ Chapters III and IV describe the Fall 1974 and Spring 1975 field t 



ests. 



CHAPTER III 



HELD TEST 2 (FALL 1974) 



The Fall 1974 SOC procedures differed from the preliminary version in 
two major respects: (1) the information given to students was scrambled so 
as not to be associated with any particular occupation, and (2) students 
were given unsolicited information about each occupation^^ potential Jfor 
satisfying certain values* Procedures and outcomes of the Fall 1974 field 
test follow* 

Administratio n Schedule 

The administration schedule used in the Fall 1974 field test was the same 
as that used the previous springs Two separate hours of each student*s 
time were needed to complete the projects Half the students played the SOC 
game during the first hour; the other hdlf i^ere interviewed firsts A week 
usually elapsed between the first and second parts of the study* During 
the second hour, students who had played SOC first were interviewed, and 
vice versa* To avoid contamination, a student played the game with one re- 
searcher and was interviewed by another researcher* 

Pescription of Sample 

The four area schools participating in the second field test were the 
same ones used in the Spring of 1974 for the first field tedt« Tiro were 
four-year .schools from which both freshman and seniors were drawn« The 
other two were complementary junior and senior high schools from the same 
district* 



The same procedures for selecting the sample and .eliciting student par- 
ticipation were used« Parent permission was required as before^ 

Of che 124 students initially contacted (See Table III-l), 84 agreed to 
participate* Of the 84 who agreed, complete data were collecte<i for 38 
ninth graders (2i girls and 17 boys) and 34 twelfth graders (19 girls and 
15 boys)* 
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Table III-l 
DESCRIPTION OF SAMPLE, FALL 1974 



Grade 9 Grade 12 Total Gr. 9 & Gr. 12- 





No* 

Contacted 


No. . 
Agreed 


No. 
Completed 


No. 
Contacte 


No. 
I Agreed 


No, 

Completed 


No. 

Contacted 


No. 

Agreed 


No. 
Completed 


School A 


23 


15 


13 


20 


13 


12 


43 


28 


25 


School B-1 


18 


14 


13 








39 


30 


27 


School B^2 








21 


16 


13 








School C 


24 


15 


12 


18 


11 


9 


42 


26 


21 




TOT/-L 


65 


44 


38 


59 


40 ■ 


34 


124 


84 


. 72 
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SOC Procedures » Fall 1974 

The student was Confronted with the task of selecting one of three unidenti- 
fied occupations which he would most like to prepare for. To help make this 
choice^ the student could ask five questions. Since the occupations were not real» 
the student was advised not to try to guess what they were but rather to ask about 
those characteristics that were of major importance in making a career choice* 

The game was ^divided into three parts. In Part 1, after the task had been 
fully explained^ the student was given a few minutes to think about the kinds of 
questions to ask and was provided with paper in order to make notes* Questions 
were asked and answered one at a time. Answers to questions were first given with 
the order of occupations scrambled so thateach item of information would be con- 
sidered independently. Each time the student asked a question^ the interviewer 
wrote a shortened form of the question in the question column on the game bf^^rdj 
provided answers (on information cards) in scrambled order» obtained the student*s 
ratings of the occupations (as indicated on the attractiveness scale) ^ recorded 
the ratings (on the recording form)» and then placed the information cards» in 
correct order (i*e.» associated with appropriate occupation)* into the cutouts in 
the game board. 

After the student*s first five questions had been answered, the game board, 
on which answers to these questions had been accumulated in correct order, was 
shown to the student. The student was then asked to rate the overall attractive- 
ness of the occupations and to designate which one he would choose to prepare for. 

In Part 2, the student was given a second opportunity to obtain information 
about the occupations. At this stage of the game, instead of freely framing (Ques- 
tions, a student selected from lists provided. The lists contained items of in- 
formation that fell into thVee categories: Occupational Values, Abilities and 
Other Re(iuirements,and Working Conditions* *A short definition of each item in 
these categories was also provided. The student was asked to select a total of 
three items about which he would like information. As in Part 1, the informa- 
tion for each item was first presented independent of any association with the 
other information, and the student rated the attractiveness o£ each occupation 
as if this were the only piece of information available about it. The game board, 
on which responses for these three questions were sorted according to occupations, 
was shown to the student with the information from Part 1 covered. The student 
then rated the attractiveness of each occupation and made a choice of one occupa- 
tion on the basis bi responses to the three questions taken together. 

In Part 3, the student was given information about thre^ occupational values 
that he had not asked about. Once again, the information for each value was first 
presented independent of any association with the occupations; then ratings based 
on the single items of information were made; ratings based on the three unsoli- 
cited value items were made (infpr*nation from Part 1 and Part 2 were covered); 
and the student chose the occupation preferred. 

Next, the student reviewed all the questions that he had asked, plus the 
three questions that had been posed and answered by the interviewer. The student 
assigned a rating to each question to indicate its importance to him. 
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Finally^ the student saw all the Items of Information on the game boards 
sorted according to occupation^ and made a comprehensive ratln;^ of the three 
occupations as well as a final choice* The "real'' names of the occupations 
on which the SOC occupations were based were then revealed* 

Description^ of Materials 

The game materials Included (1) a game board and pad» (2) occupational 
Information^ (3) two ratlnp^ scales^ one for occupations aAd one for questions^ 
and (4) a recording form* 

Game board * The game board (Fif^ure C) was used to record a shortened 
form of a student's question and to accumulate Information given In response 
to questions asked* Typically^ the student and Interviewer were seated side 
by side at a table* The SOC game board was placed to one side of the Inter- 
^ viewer^ so that the Interviewer could write on the board and place Information 
cards there without Interfering with the flow of the game* Though the game 
board was fairly sturdy and could be supported on one^s lap» It was generally 



^ The board Itself was a 13" x 19" rectangle made of two sheets of oaktag* 
It had four columns of cutouts, each cutout 1-1/4" x 2-1/4" In size to accom- 
modate Information cards* A sheet of paper on which the examiner wrote, .In 
shortened form, the question a student had asked, was placed under the first 
column* !^he second, thlfd, and fourth columns were used, to accommodate re- 
sponses to each question by the Insertion of Information cards Into, the cut- 
outs* At ^e completion of the game, the Information c^rds were picked up and 
replaced In a folder for use the next time the game was played* The sheet of 
paper on which ♦'he Interviewer noted the student's questions wa,s sometimes re-- 
talned, althou^,. this was not usually necessary since th^ Interviewer also 
noted th^ student's questions on the recording form* 

Occupational Information * The Interviewer possessed a complete array of 
Information about the SOC occupations* The SOC occupations were not real but 
were modeled on real occupations In such a way that their characteristics were 
sometimes more extreme and more clearly differentiated than is actually the 
case. In|^rmatlon about the occupations had been typed on cards (Figure D), 
sorted Into categories, and displayed In the SOC folder for easy retrieval by 
the Interviewer (Figure E)* Cards specific to each of the SOC occupations^ 
were available for all Items on the lists of Values, Abilities and Other Re- 
quirements, and Working Conditions, as well as for other questions frequently 
asked by students. 
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FIGURE C 
SOC GAME BOARD 
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FIGURE D 
SAMPLE INFORMATION CARDS 



St . 2>) AmrwU^n ;Ce^r4t (ir "(Jctfiyfe Ai^fW T^mOy " &4tiAt>t 



Training program 
given by employer 



Learn on-the-job 



Practical work 
experience is part 

of.for'rrjal education j 




Casual clothes; 

neat appearance, 



Uniform 



S«*n^4. tnOmmft^A Cpi^s ftr Trace/ O^^^hihlkt*' Cii**s^'4n 



Must travel once or 
twice a year 



Local travel 
each day 



L 



None 
required 



AVERAGE: Solves different 
problems . 
(Same people, 
same place.) 



ERIC 




GREAT; Meet different I I ^S: Activities follow a 

people^ go different! I set pattern. Meet 

places, solve ! I different people in 

different problems. | j , same room. 
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FIGURE E 
OCCUPATIONAL INFORMATION POLD^ 




oars' 





.1 



Alone/ 



J 
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Cards were developed for the following, categories of questions: ^ 



Nud-^^lcal/Mathetnatlcal Abilities 

Required 
Verbal Abilities Required 
Artistic or Musical Abilities 

Required 
Travel Opportunities 



Occasionally a student asloed a question for whlch.no Information cards 
existed. When this occurred, the Interviewer wrote appropriate answers on 
three blank cards and Inserted them Into the cutouts In the same manner as 
the pre-develot^Vd cards. Interviewers were expected to be thoroughly versed 
In the three occupations and to be capable of developing answers which had 
verisimilitude, yet which clearly differentiated the occupations. Descrip- 
tions of the occupations on which the SOC occupations were modeled and guide- 
lines f<^r generating answers to questions not anticipated were prepared for 
^hls purpose* 

Rating scales * To rate the attractiveness of the three occupations, the 
student placed markers (labeled **1,'* '*2,*' and "3" to correspond with occupa- 
tions numbered **1," *'2,'* and **3") on Rating Scale No* 1 (Figure F), The scale 
was anchored with two kinds of descriptors* The first. In bold letters, re- 
ferred to the levels of attractiveness (e*g*, so-so, pretty good), while the 
second was actlon^orleated and related to what students might or might not 
want to do as a result of what they knew about the options (e*g*, I would make 
definite plans to enter this occupation)* 



Salary (beginning, median) — 



Dress Regulations 

Dally Working Hours 

Fringe Benefits 

Special Problems/Occupntlon 



weekly, hourljr,^ or annually 
Field of Interest 
Opportunities to Help Others 
Amount of Independence 
Opportunities for Leadership 
Amount of Leisure Time 
Amount of Prestige 
Amount of Job Security 
Amount of Variety l,i People, 

Places, and Activities 
Minimum Education Required 
Occupational Training Needed 
Amount of Pressure on the Job 
Managerial Abilities Required 
Clerical Abilities Required 
Manual Abilities Required 



Research/Desk Work Required? 
Location of Employment 
Employment Outlook 
Self-Employment Opportunities 
Usual Vacation Time 
Percent of Women In the Field 
Physical Work Surroundings 
Wforklng Indoors or Outdoors 
Working Alone or with Others 



Hazards 
Advancement Opport .lities 
Opportunities to V ,'k with Children * 
Opportunities to Work .with Animals 
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FIGURE F 



RATING SCALE NO . 1 



THE <3REATe^ 

4 mitir M/J 6Ccu/«i/«M, 



i 



y^jf X W*Jl* 



Trie WDRsrr 

Wit. ttcvf^^t.ltcA OS « cAVft* 
fir 
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The sc^le on which atudents rated the Iniportance of the questions them- 
selves (l*e.^ how Important It Is for a student to learn about the dimension 
queried when deciding on his own career) ran from a low of 1 (of minor Impor* 
tantie) to a hi^gh of S (absolutely necessary). (See Figure G*) 

I' ' * 

' Recording ¥om * A copy of the recording form Is shown In Figure H. In 
the column nunibered '*1," the Interviewer recorded the student^s scale positions 
(Indicating the attractiveness of the three occupations) after the first ques-* 
tlon had been answered. Similarly, attractiveness ratings for the other Items 
of Information were recorded In cxjlumns 2 through 11. After the first five 
questions^ the student^s cumulative ratings (b^ed on the unscrambled answers - 
to the first five questions taken all together) were recorded In the first as- 
terisked column. The Interviewer circled ^he rating of the occupation the 
student had designated as the one he would most like to prepare for at this 
point* Following the same procedure^ cumulative ratings for three l^ems of 
information taken together were also recorded In .the^BSteVlsked columns^^f ol- 
lowing apswers to questions 8 and 11* At the end of the game, when all 11 
pieces of Information had been unscrambled, the student rated each occupation 
at: a whole, and selected the one he would most like to prepare for* This was 
recorded In the double-asterisked vertical column* Recorded In the row 
labeled "Q" were the student^s ratings of the Importance of each question* 

i 

The small numbers In the boxes on the top rpw (123, 132, etc*) told the 
interviewer how to "scramble" the order of the three occupations In presenting 
each It'^em of Information on the game board* If more than one game was played, 
the bottom form was used* 
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RATIMG SCALE NO. 2 
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ID No* 



FIGURE H 
SOC RECORDING FORM 



Student's Name Grade/School Interviewer's Name Date 
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Descrlptlon of SOC Measures ' ^ 

Scoring procedures, broadly conceived, included the following kinds 
of i&easures : < 



Numeric 

(1) Relative Distances - D ,2/1, D 3/1 

Distances moved In Parts 2 and 3 relative to Part 1 (D 2/1 and 
D 3/1 respectlvely)provided Indices of how well a student had succeeoed in 
generating the "right questions/' 

They were defined ds; 



D 2/1 ^ 



D 3/1 ^ 



83 








6 1 


°« 


- 7 




5 3 








t £ 
1 1 


% 


- 7 




11 3 








It- 
9 1 


1 'a 


- 7 




5 3 








i t 
1 1 




- 7 





^ 16 2/3 j 



(l6 2/3) 



Where, 0., was the scale position (on the attractiveness scale) of oc- 
cupation ^ 1 (1«1, 3) for the jth question (1*»1, ll)* Scale position 
distances were accumulated as differences from the midpoint of the scale which 
is 7* 

Movement of the markers In Part 1 gave a measure of the Importance to stu- 
dents of the constructs or dimensions that they produce on their ovn in thinkr 
ing about aft occupational choice* Movement^.ln Part 2 gav6 a measure of the 
Impact of information that students recognized a s Important when given con- 
structs or dimensions to choose from* Movement in Part 3 gave^ a measure 
of the Impact of unsolicited information provided by the interviewer* 
The ratio of distances moved In Part 2 and 3 relative to. Part 1 cancelled out 
effects of response style (some students tend to make large moves and others 
small moves)* Ji permitted full focus on students' cognizance of the constructs or 
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dimensions that were indeed important to them in making an occupational choice* 
Students who knew what was important to them would presumably have asked the 
"right questions" in Part 1, They were justified in not askinft the other ques- 
tions, should have been relatively unaffected by the unsolicited information, 
and should have made relatively small moves in Parts 2 and 3* But students 
who made relatively large moves in Parts 2 and 3 had presumably failed to ask 
the "right questions" <for them) in Part 1, They had low cognizance of the 
constructs or dimensions that indeed turn out to have had a big impact on their 
choices. 

<2) Relative Importance of Questions - I 2/l, I 3/1 

The ratio of the average importance of questions in Part 2 ?nd 
Part 3 to the average Importance of the questions asked by students in Part 1 

provided other indices of how successful students were in generating good 
questions < 

These measures were defined as: 



I 2/1 = 




Where, Qj^ was the average scale rating <on importance scale) assigned 
to questions asked in Part 1, and Q3 "^^^ average scale ratings 

for questions asked in Parts 2 and 3. 



A large value for I 2/1 indicated that a student had failed to ask 
<luestions that he could recognize as important, Similarlv, a l^^S^ value 
for I 3/1 indicated that a student had failed to ask or recognize questions 
about occupational values that were important to him. 

Hon -numeric 

(1) Consistency of Choice 

The consistency of a student's successive choices of occupa- 
tion at the end of Parts 1, 2, and 3 of the game, gave an overall indication 
of the impact of information received in response to freely-formed questions, 
items recognized as important, and unsolicited information about values, 
respectively. 

<2) Desirability of Choice 

After playing SOC, students made ratings of the importance of 
ten occupational values* On the basis of these ratings, it ^^as noted whether 

a student selected the occupation that had the (greatest potential for satis- 
fying his values, weighted according to the importance each student had 
attributed to them. 
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(3) Kinds o£ Questions Asked 

Classification of student's questions Into such content cate- 
gories as values^ activities^ working conditions* etc.» provided a means 
for examining the nature of the constructs he used for occupational decision- 
making. The description of question content was a potent:^.ally useful diag- 
nostic tneasure and was not Inttr^nded for evaluation purposes* 



Frequency of Selection of Each Occupation In SOC Game^ Fall 1974 

As Indicated In the description of the Fall 1974 version of tfee SOC 
gaine» students i^ere allotted to ask five questions of their own devising at 
the beginning of the gatne; they then selected three questions from a display 
of the full structure of the information; finally* they received three un- 
solicited Items of Information. Table 111*2 shows the frequency with which the 
students selected each of the three occupations (constructed from and labeled 
here for convenience .''Retail Store Manager,'* *'%wspaper Reporter,** and **X-Ray 
Technologist**) following their first five questions and at the end of the 
gatne In their final choice* 

*'Hewspaper Reporter'* was the most frequently chosen In both Instances 
for both grades* As a final choice, 57% of the ninth gradeirs^ 53% of the 
twelfth graders, and 55% of the total group selected Newspaper Reporter* 

'*Retall Store^ Manager** was the second most frequently selected SOC oc- 
cupation 30% of both the ninth and twelfth graders and 31% of the total 
group chose it at the end of the game* 

The least frequently selected occupation was "X-Ray Technologist*** It 
was used as a final choice by 13S; of the ninth graders* 17% of the twelfth 
graders, and 15% of the total group* 

By looking; at the choices made after the first five questioi>s and at 
the final choices, one can see the impact of unsolicited Information on a 
few of the stud^ts* In every case a few students' minds were changed by 
what they learned as they pl^d the game. Three more ninth graders were 
attracted to **Ne\7Spaper Reporter** as the game continued. For twelfth graders 
the reverse was true: three fewer twelfth graders chose .**Newspaper Reporter.** 



Frequency of Selection of Each Occupation Compared With Spring 1974\ 

Table 11-2 (see Chapter 11, p* 18) shows the selections made by, 
students In the Spring 1974 sample* At that time, **Newspaper Reporter** 
did not have the universal appeal that It did to the Fall 1974 group* The 
ninth graders l^i the Sprlag of 1974 preferred *'Retail Store Manager*" As 
before, howeverj''**X-RaV Technologist" was the' least frequently selected* 
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In the SOC administration of Fall 1974 the facts concerning each occu- 
patlcm wre constructed to obtain clearest possible differentiation* This 
was done to avoid any situation in which the students would receive identical 
Information for two different occupations, since such Identities would pre- 
vent differentiated reactions* * 

The effect of this new structuring of the SOC g^me Is visible when one 
compares these tiro tables* For example, while "X-Ray Technologist" was the 
least attractive to both samples, the low^r percentages In the Fall 1974 
group suggest that the sharper differentiation of information resulted in 
lowering the desirability of this occupation in the Fall 1974 SOC version* 
Conversely, the percentages for the more attractive occupations were higher* 



TABLE III-2 



FREQUENCY OF SELECTION OF EACH OCCUPATION IN SOC GAME, FALL 1974 

"Retail Store "Newspaper "X-Ray 

Manaper" Reporter" Technologist" 

9th Grade 

After first 5 U% 50% 162 

(13) (19) ' (6) 

Final 30% ■ 57% 13% 
. (12) (22) (4) ■ 

12th Grade 

After first 5 25% 612 14% * 

(9) (22) (5) 

Final 30% 53% 17% 
(11) (19) (6) 

Tota l 

After first 5 ' 30% 55% 15% 

(22) f^l) (11) 

' Final 31% 55% 15% 
(23) (41) " " " (10) 
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"Desirability" of Occupations "Chosen'^ 

Table III-3(a) shows, by grade,, the percentage o£ students whose occu- 
pational choice at the end of Parti (after self -genera ted questions and 
before tmsolltilted Information) was an occupation with the highest, second 
highest, or lovest desirability sum* 

In a little over half of the cases (53^), students chose the occupation 
which had the highest desirability sum. Seniors were slightly more likely 
(SSZ) to select an occupation with the highest desirability sum than were 
freshmen 

Twenty-seven percent of all students selected an occupation with the 
second highest desirability sum* Seniors did so more often (33^) than did 
freshmen (21%), 

Eighty percent of all students In the sample selected an occupation with 
either the highest or second highest desirability* 

Freshmen were four times as likely (32^) as seniors (83S) to select an 
occupation with the lowest desirability sum* 

Table ni-3(b) shows, by grade, the percentage of students whose occupational 
choice at the end of the game was an occupation with the highest, second 
highest, or lowest desirability sum* Overall, the percentage of students 
selecting an occupation with the highest desirability Increased from 53^ to 
59%* Once again seniors were slightly more likely (61%) to select an occu- 
pation of highest desirability than were freshmen (5S%) * 

The overall percentage of students selecting an occupation of second 
highest desirability stayed the same (27%), with the same percentages of 
seniors (33%) an4 freshmen (21%) as In Table III-3(a) * 

At the end of the game, a slightly smaller percentage of all students 
(14% as opposed to 20% at the end of Parti) selected an occupation with the 
lowest desirability sum* While the percentage of seniors selecting an occu- 
pation of lowest desirability dropped only two points from the end of Parti 
to the end cf Part 3, the percentage of freshmen selecting an occupation 
of lowest desirability dropped by eleven percentage points* 

In general, when we compare Tables III-3(a) and Ili-3(b) of the Fall 
1974 study with corresponding tables In the Spring 1974 studv (see p* 20) 
we see that seniors In the fall study consistently led the freshmen In se- 
lecting occupations of highest and second highest desirability, whereas re- 
sults of the previous spring were mixed, with freshmen leading some of the 
time* As in the spring study, freshmen apaln chose the occupation with the 
lowest desirability sum more frequently than seniors, but we now see a greater 
percentage doing so (end of Parti , 32% compared to 13%; end of game 21% 
compared to 8%)* We still see over half of all students choosing the occu- 
pation with the highest desirability sum, but there is a slight decrease in 
the percentage doing so (end of Parti j 53% compared to 62%; end of game 
59% compared to 62%)* 
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TABLE III-3<a) 



FREQUaO WITH WHICH OCCUPATIONS AT VARIOUS LEVELS OF DESIRABILITY WERE CHOSEN 

AT END OF PARI i» FALL 1974 





f 


Highest 
Desirability 


Second Highest ' Lowest 
Desirability 1 Desirability 


Grade 9 


47% 
<18) 


21% 
<8) 


32% 
<12) 


Grade 12 


58% 
<21) 


33% 
<12) 


' 8% 
<3) 


Grades 9 h 
12 Total 


53% 
<39) 


11% 
<20) 


20% 
<15) 



TABLE III-3<H) 



FREQUENCY WITH WHICH OCCUPATIONS AT VARIOUS LEVELS OF DESIRABILITY WERE CHOSEN 

AT END OF GAME» FAU 1974 



■ 










Highest 
Desirability 


■ ■ 

Second Highest 
Desirability 


Lowest 

Desirability 


Grade 9 


58% 
(22) 


21% 
<8)- 


21% 

Ca) 


Grade 12 


61% 
<22) 


33% 
<12) 


<2) 


Grades 9 h 
12 Total 


59% 
<44) 

• 

r 


27% 
<?0) 


14% 
' <10) 
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Comparlng Types of (Questions Most Frequently Asked by Ninth and Twelfth Graders 

What ninth and twelfth graders construed as Important Information about 
occMpatlons was expressed In the questions asked In playing SOC. Frequencies 
of various constructs or categories of questions are shown In Tables III-4» 
III-5, and III-6. In the rlrst staRe of the eaiue. students asked five spon- 
taneously-Initiated questions (Table Questions 1-S). Hext» students 
were given the opportunity to select three questions from a prepared list 
(Tabl6 III-S; Questions 6-8). Finally^ all eight questions were combined 
In the third table (Table III-6; Questions 1-8). In separate colums for 
ninth and twelfth graders, all three tables give frequencies, percentages, 
and rank order of frequencies of the questions asked. By comparing the 
columns, similarities and differences can be observed In the career concerns 
\o£ the groups at the two grade levels. 

In Table III-4, showing the data on the questions Initiated directly by 
the students, the first six questions were most frequently asked In both groups, 
although In slightly different rank order. "Field of Interest" was the most 
common concern of seniors, while "salary" ranked first for freshmen: seiiiors — 
but not freshmen — ranked "education" ahead of "leisure" and "variety." The 
differences In percentages, however, were very small. It is clear that ques- 
tlons on the first three topics ("salary," "physical surroundings," "field of 
lnterest")were most popular in both groups, with nearly equal frequencies. 
The next set of three topics ("education," "variety," "leisure") also ran very 
close In popularity for both groups. But 9th graders asked a noticeably larger 
number of questions about activities than did the 12th graders, while 12th 
graders were much more concerned than 9th graders about opportunities for ad- 
vancement , 

Table III-5 shows what questions were selected by students from a list 
after the first five self-generated questions had been answered. They lllus** 
trate the questions students recognized as Important even 'though they had not 
been mentioned in the free situation. Since none of the first five questions 
could be repeated, Table III-S would not be expected to show the same pattern 
as Table ITI-4. Indeed, "salary" moved into the lor^er part of the column 
(ranking 6.2 for seniors and 8 for freshmen). Clearly, students who re- 
garded salary as Important tended to make that concern explicit and frame 
a question about it. Xet for both groups "field of Interest" was still at 
the top, "variety" was second Instead of fourth, and "physical surroundings" 
third. "Helping others" and "fringe beoeflts*' moved up for freshmen; "fringe 
benefits," "p^^essure," and "security" for seniors. 

Table III-6, combining the data of Tables III-4 and III-5, should give 
a more complete picture of Residents' concerns regardless of whether the ques- 
tions were constructed or tn^r'^iy selected. It shows that again the first six 
questions at the top of the list were the same for both age groups although 
they appeared in slightly different order. Clearly, "field of interest'* 
appeared as the primary Interest of both groups, and "physical surroundings" 

second. After that, the freshmen ranked "salary," "variety," "leisure," 
"education" in that order, while senior^ asked about "variety," "salary," 
'^education*" and then "leisure/' Even the next two questions, "co-workers" 
and "helping others," were parallel in rank for both groups before wider 
differences began to appear. ' 
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TABLE 

TOPICS OP QUESTIONS 1-5 (SELF-GENERATED) ASKED BY 9TH AND 12TH GRADERS, TABULATED 
BY FREQUENCY, PERCENTAGE, AND RANK ORDER OF FREQUENCY, FALL 1974 





9th graders 


(39)* 


12th graders (36)* 




1 


X 


_r 


1 ■ 


% 


r^ 


$ Salary 


27 


14% ' 


1 


,24 


13% 


' 2 


Physical Surroundings 


26 


13%^ 


. 2 


20 


11% 


3 


Field of Interest 

• > 


24 


12X^ 


3 


27 


15% 


1 


Leisure 


17 


9% 


4,5 


15 


8% 


.5.5 


Variety 


17 


' 9% 


4.5 


15 


8% 


5.5 


Education 


16 


8% 


5 


18 


10% 


4 


Activities 


14 


7% 


6 


3 


2% 


12.5 


Co-Workers 


12 


6% 


7 


11 


6^1% 


6.5 


Helping Others 


7 


4% 


8 


' 10 


5.5% 


7 


Independence 


• 6 


3% 


9.3 


6 


3.3% 


8 


Location 


6 


3% 


S.'3 


2 ^ 


1.1% 


11.2 


Dress 


. 6 


3X. 


9.3 


2 


1.1% 


11.2 


Fringe Benefit^ 


5 


2.5% 


10 


4 


2.2% 


9 


Security 


2 


1% 


11.2 


2 


1.1% 


11.2 


Outlook 


2 


1% 


11.2 


3 


2% 


10.3 


Leadership 


2 


1% 


11 2 


3 


2% 


10.5 


Pressure 


2 


1% 


11.2 


0 


OX 




Personal Contact 


1 


' .5% 


12.2 


2 


1.1% 


11.2 


Advanc^ent 


1 


.5% 


12.2 


11 


6% 


• 6.5 


Prestige 


1 


.5% 


12.2 


0 






Danger 


1 


.5% 


.12.2 


1 




12.5 


Personal Qualifications 


0 


0% 




1 




12.5 


Type of Employer 


0 


0% 




0 






Total Ho. of Questions 


195 






180 ' 







In addition to complete data cases > this Includes one 9th and two 12th grade 
students who completed the game but not the Interview. 
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TAgLB I I 1-5 

TOPICS OF QUESTIONS 6-8 (SELECTED FROM LIST) ASKED BY 9TH AND 12tH GRADERS, TABU- 
LATED FREQUENCY, PERCENTAGE, AMD RANK ORDER OF FREQUENCY, FALL 1974 





9 th 


graders 


(39)* 


12th 


crade^s 


(36)* 




I 


% 




1 


% 


r_ 


Field of Interest 


28 


24% 


1 


25 


23% ' 


1 


Variety 


■ 12 


103! 


2 


14 


133! 


2 


Physical Surroundings 


11 


9% 


3 


12 


11% 


3 


Leisure ■ 


9 


%t 


4.3 


6 


5.5% 


5.3 


Helping others 


9 


8% 


4.3 


2 


2% 


7.2 


Fringe Benefits 


9 


8% 


4.3 


7 


6.4% 


4.5 


Presr ire 


6 


5% 


5 


7 


6' 4% 


4.5 


Security 


5 


4% 


6 


6 


5.5% 


5.3 


Co-workers 


4 


3»4% 


7.5 


4 


4% 


6.2 


Danger/Hazards 


4 


3.4Z 


7.5 


4 


4% 


6.2 


Salary 


3 


2.5Z 


8 


4 


4% 


6.2 


Education 


3 


2.5% 


8 


6 


5.5% 


5,3 


Independence 


3 


2.53! 


8 


4 


4% 


6.2 


Leadership 


3 


2.5% 


8 


2 


2% 


7.2 




3 


it . jh 


ft 


2 




7 2 


Prastlge 


2 


1.7% 


9 


2 


2% 


■ 7.2 


Personal Contact 


1 


.8% 


10 


0 


0 




Advancement 


a 


.8% 


10 


0 


• 




Outlook 


1 


.83! 


10 


0 






Activities 


0 






1 


.9% 


8 


Location 


0 






0 






Type Qf Employer 


0 






0 






Total Hp* of Questions 


117 






108 







In addition to complete data cases » this includes one 9th and two, 12th grade 
students who completed the game but not the interview. 
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\ TABLE III-6 

TOPICS OF QUESTIONS 1-8 (SELF-GEMERATED AND SELECTED COMBINED) ASKED BY 9TH AND 
12rHE GRADERS, TABULATED BY FREQUENCY, PERCENTAGE, AND RANK ORDER OF FREQUENCY, 

^FALL 1974. 





9th Kradets (39)* 


12th graders (36)* 




z 


~ I 


r 


z 




r 


Field of Interest 


52 


r 

, 17% '[ 

\ 

12% ^ 


1 


52 


182 


1 


Physical Surroundings 


37 


2 


32 


11% 


2 


Salary 


30 


lOX 


3 


28 


9,7%' 


4 


Variety 


29 


n \ 


4 


29 


10% 


. 3 


Leisure 


26 


8z - ; 


5 


21 


7% 


6 


Education 


19 


6% ■ 


6 


24 


8% 


5 


Co-Workers 


16, 


\ 


7.5 


15 


5% 


7 


Helping Others 


16 




7.5 


12 


4% 


8 


Activities 


14 


k.ki \ 


8 


4 


1,3% 


14 - 


Fringe Benefits 


14 




8 


11 


3.8% 


9,5 


Independence 




3% \ 


9.5 


10 


3.4% 


10 


Dress 


9 / 


3% 


,9.5 


4 


a. 3% 


14 


Pressure 


8 


2.5!: 


io 


7 


2.4% 


12 


Security 


7 


22 




8 


2.7% 


11 


Location 


6 - 


1.9X 


i2 


2 


.6% 


16 


L^ftd^r^h in 


5 


1.6Z 


13 ' - 


5 


2% 


13 


Outlook 


3 


.9Z 


14.5 


3 


n 


15 


Prestige 


3- 


.9% 


14.5 


2 


.6% 


16 


Personal Contact 


2 


.6Z 


15.5 


2 


.6% 


16 


Advancei3ient 


2 


.6!!; 


15.5 


11 


3,8% 


9.5 


Type of Employer 


0 
0 






0 






Farsonal Qualifications 








.3% 


17 


Total No. of Qu«stionj^ 


312 






288 






* 

In addition to Qompl^te data cases» thJ^ 
:^tudt^[it& who Cf^pletec the game but not 


> 

s includes one 9th and two 12th grade 
the Interview. 
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A comparison of the fall results with the Spring 1974 test (see p. 22) 
shows that^ in spite of some changes in game procedure^ the topics covered in 
the questions asked by students were quite similar for both samples^ 

/ 

It was noted that in the Fall 1974 procedures students as^4d five 
questions of their own construction. In the spring test, how€tver/ students 
had been permitted to ask as many questions as they^wished. TJhis condition 
produced a difference between age groups in total number of questions asked, 
a difference not possible in the fall trial. Nevertheless, me proportional 
frequencies of the topics can be compared across occasions^ j 

■ - ' / ■ 

In the spring test, the most n'opular topic was "activities;" in the 
fall (Table III-6) it was "salary*' ^nd "field of interest/'/ However, the differ- 
ence between "activities" and "field of interest" may be largely a matter 
of definition of topics and classi£i9ation of questions^ /"Activities" and 
"field of interest" are closely related, and classification of a question 
as one or the other was sometimes 'difficult* For example; "Does it involve 
mechanics?" could' be taken ab a Question about "activitiibs, " or it could be 
taken as a question about "fields of interest." I - . 

-After "activities," howevfer, the next six categories of questions in the 
spring test are the same as th^ top six in the fall. Within these six, one 
difference is the fact that physical surroundings are iin second place in the 
fall list, although ranked only 5 and 7 for 9th and 12th graders in the 
spring. / 

i ^ 

The much smaller number of' questions about "personal contact*^ in the 
fall test probably reflects anl attempt on the part of interviewers to probe 
what students meant by "persona!f.'contact«^^ Asked to, be more specific, stu- 
dents usually replied with one of two other categories — "helping other people," 
or simply "workinfj with other people rather than alotie" (co-workers). There 
were still a few questions classified only as "persdnal contact,." 

To summarize, then, freshmen \and seniors were quite similar in the fre- 
quencies with which they asked abp^t various topics, and the same concerns 
tended to continue uppermost for th^ separate samples in the two tests. 



\ 
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Means and Intercorrelatlons of SOC Measures 



Means and standard deviations for SOC jneasures, by grade, are presented 

In Table III-7. D 2/1 and D 3/1 are relative distance measures, I.e., dis- 
tances moved In Parts 2 and 3 relative to Part 1; I 2/1 and I 3/1 are the 
ration of the average importance of qii^stlons (as designated by students) 
In Part 2 and In Part 3 to the average importance of questions In Part 1. 
These measures are described In greater detail under the section headed 
"Description of SOC Measures," p. 48. NotTe that a score of 10 on the D 
measures Indicates that the average move In Parts 2 oi* 3 of the game Is the 
same as In Part 1; a score of 10 on the I measures Indicates that the aver- 
age Importance attached to questions In Parta 2 and 3 Is the sanie as lihat 
attached to questions In Part 1. 

As seen In Table III-7, negligible differences were found between the 
grade samples on all of the SOC measures, and mean scores for both groups 
tended to fall around 10. The sample variation noted for the measures was 
encouraging, since It Indicated that students differed considerably In the 
behaviors reflected by the ratio of distances moved in Parts 2 and 3 of SOC 
relative to Part 1* 

Table III-8 gives the Intercorrelatlons between the SOC measures. With 
the exception of D 3/1 with D 2/1, the correlations are seen to be low — a 
somewhat surprising finding since the I and D* measures are conceptually re- 
lated. This led us to examine the relationship between the Importance rat- 
ings students gave questions and the movements made In resppnse to questions 
(see "Relationship, between Importance and Attractlveneijs," p. 64). 



TABLE III-7 . • 

MEANS AND STANDARD DEVIATIONS OF SOC MEASXJRES, PALL 1974 

' Grade 9 Grade 12 





X 


S.D. 


X 


S.D. 


D 2/1 


10.3 


2.9 


9.6 


2.6 


D 3/1 


9,2 


3.0 


9.2 


2.6 


: 2/1 


9.4 


2,9 


10.4 


3.2 


I 3/1 


11.4 


2.7 


10.4 

+ 


3.5 






TABLE 


III-8 





IHTH;RC0RJIELATI<»IS AMONO SOG ^EASURES, FALL 1974 
D 2/1 D 3/1 I 2/1 I 3/1 

D 2/1 1.0 

D 3/1 .53 

I 2/1 .15 

I 3/1 -.01 

ERIC 



' 1.0 

.24 1.0 
-.04 .18 1.0 

71 



-60- 



SOC and Interview Correlations 

Correlations between SOC and interview scores are presented in Table 
III-9, The table shows that none of the correlations were significant — a 
most disturbing finding since it indicates that the changes made in SOC 
procedures did not succeed in making scores more congruent with interview 
scores. Indeed^ correlations between the construct scale and the distance 
measures computed in the Spring 1974 test (r = ,37 for DIST 1 and -,40 
for DIST 3 ) decreased to near zero for the corresponding distance measures 
used in the Fall 1974 test (r = ,03 for D 2/1 and -,01 for D 3/l), These 
findings led us to probe more deeply into the assumptions underlying the 
model for SOC procedures and scores and to devise tests for some of these 
assumptions. 



TABLF in-9 

CORREUTIONS BETWEEN SOC AND INTERVIEW, FALL 1974 
(9th and 12th grades combined) 



D 2/1 D 3/1 I 2/1 I 3/1 



Constructs 


-.03 


-.01 


-.07 


-.26 


Information 


-.15 


-.11 


.07 


-.02 


Reality 


-.06 


-.03 


.05 


-.16 


P lanning 


-.08 


.02 


.12 


-.06 


Control 


-.07 


.03 


.10 


.04 


Awareness 


-.09 


-.07 


.00 


-.09 
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The SOC Model 

It will be recalled tliat the original procedure for SOC gave students 
successive Items of In format l*ti associated with each of the three occupations. 
Students Indicated their reaction (In terms of attractiveness of the occupa- 
tions) after receiving each item of information* But we had no clear way of 
determining the extent to which the reaction, to the nth item represented the 
impact of that item alone or the accumulated effect of n-1, n-2, etc. In 
other words » there was no way of distinguishing and controlling for the ef-^ 
feet of each item vls-a*"vls the interaction effects accumulated across sue*' 
cesslve items of information* 

In brief, the Fall 1974 revision was undertaken to dissociate each bit 
of information initially from the occupation and thus from the cumulative 
information about that occupation* The student's reaction to that item would 
be independent of his reactions to previous items of information and the im- 
pact of that item could be registered as if it were the only item of informa- 
tion the student had* Then, at a later point, the various items of informa- 
tion were grc-uped by occupation, and the student could determine the attrac- 
tiveness of each occupation in terms of all the information available* 

Since this procedure allowed us to isolate the effect of each item and 
the cumulative (presumably interacting) effect of all items* we expected to 
be in a position to test hypotheses about the models of decision-making that 
students used. For example, one important question was whether the data sup- 
ported a linear model* That is, could the final positions of the three Oc- 
cupations on the scale of attractiveness be predicted by a simple summation 
of the positions after each item of information treated independently? Or, 
in more general terms, was there any function of the independently determined 
effects that could represent or predict the final scale positions? 

To examine these questions, a regression analysis was run for the data, 
later to be followed by test for linearity [JIald, 1952, p, 534]* A separate 
analysis was run for each occupation* 

Since the items of information that a student responded to were dis- 
tinguishable only by position (l*e,, question one for a student may have 
been abrut "salary," "leisure," or any other factor), the first five scale 
ratings were summed* Since it was of no consequence for testing the hypo- 
thesis of linearity which valuable was considered as Independent or de- 
pendent, the summed ratings wdre used as the dependent variable and the 
cumulative ratings made after the first five questions as the Independent 
variable to make the* actual nest easier* These results are presented in 
Table 111-10* 
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TABLE III-IO 



PREDICTORS OF FINAL SCALE POSITIONS 



Reg* Weight Intercept Correlation 

Retail Store Manager .16 1.51 .49 

Newspaper Reporter .18 1^55 .53 

X-Ray Technician .15 1.59 .55 

It Is worth noting that the size of the correlation found Indicated that 
In playing SOC, students were behaving in a thoughtful manner. This was en- 
couraging since procedures and directions for SOC had obviously become quite 
complex in this version and we were concerned about students' understanding 
of the conditions^ the tasks» and the scales. 

. 

Results from a test for linearity Indicated that the linear model was 
not inappropriate ,(F value less than 1). The ANOVA table for Newspaper 
Reporter Is presented below. 



TABLE III-ll 



ANOVA" TABLE - NEWSPAPER REPORTER 



Source 


SS 


DF 


MS 




134, 832 


1 


134,832 


B 


1,483 


1 


1,483 


Non- 
Linearltv 


602 


11 


54.7 


Error 


14,975 


62 


241.5 


TOTAL 


151,892 


75 





Following thls» another regression, analysis was run In which the five 
position points (a position point corresponds to a question asked by a stu- 
dent) were used as Independent variables and the cumulative rating was the 
dependent variable. A test of significance indicated th^t the beta weights 
were not affected by position. In other words » maintaining information about 
position did not seem to significantly increase prediction levels. Further^ 
the analysis failed to shed light on the nature of the relationships between 
position and information processing. For occupation one» questlpns asked 
in positions 4 and 2 accounted for most of the predictive variance while 
questions asked In position S for occupation two and positions 4 and 3 for 
occupation three accounted for most of the variance. The only consistent 
finding across the three occupations was that the first question asked by 
students was the least Important in accounting for a student's overall final 
evaluation of an occupation. 
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An attetnpt was tnade to get at the relationship between the Impact of dif- 
ferent kinds of content of Information and final ratings. Two questions, 
"salary" and "leisure/* were Identified as being asked by sizeable numbers of 
students. Correlations between distance moved after receiving Information 
about "salary" and "leisure" and final ratings are presented In Table III-12. 
Since Information level was tied to content and not occupation (e.g., Retail 
Store Manager was high on "salary" and low on "leisure"), the table Is pre- 
seated for Information levels rather than occupations. 



TABLE III-12 

CORRELATIONS BETWEEN DISTANCE MOVED AND FINAL RATING BY CONTENT OF QUESTION 

AND LEVEL OF INFORMATION RECEIVED 



Content of Question Level of Information 





Low 


Medium 


High 




Salary 


.37 


,07 


.26 




Leisure 


.20 


.31 


.15 





As would be expected, when the level of Information about salary was 
high or low, distance moved was seen to have a relatively high correlation 
with a student^s final rating; that Is, the Impact of high or low salary on 
final rating was much greater than the Impact of medium salary. Conversely, 
a medium amount of leisure resulted In a move that was more highly correlated 
with final rating than either high or low leisure. 

From these data, and other observations, we can reasonably Infer that 
students tended to rate occupations with hi gh salaries favorably and occupa- 
tions with low salaries unfavorably, while a medium amount of leisure was per- 
ceived as more favorable than a high or low amount. 

This finding points up a problem of which we became aware somewhat belated- 
ly. While some dimensions of occupational characteristics clearly "scale" (e.g.. 
In the sense that more money was generally prefer^^ble to less), others do not. 
For Instance, a medium level of leisure or of responsibility may strike many 
students as more desirable than either high or low levels, which may be per- 
ceived as equally undesirable. In other words, there are different points of 
view: wheo a student asks a question about leisure or responsibility, we do 
not Immediately know whether a high, medium, or low level Is preferred. It was 
an attempt to resolve this problem that led us. In the next version of SOC, to 
have students make "specifications," stating what was desirable, rather than to 
have them merely ask questions. 
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ReXatlonshi^p between , Importance and Attractiveness 

To make a fundamental test o£ the logical consistency o£ students' be- 
havior on SOC, we computed correlations between two sets ot variables that 
should be significantly related in rational decision-making • One variable 
Cor each student was the difference between highest and lowest position on 
the attractiveness scale assigned after each independent item of information* 
The other variable was the weight that the student ajsigned to each question 
to indicate its importance to him* These weights were assigned on a scale 
running from 1 (of minor importance) to 5 (absolutely necessary), to each of 
the 11 ''questions** — five generated by the student, 3 selected by him from a 
display of the categories, and 3 chosen by the interviewer as a basis for 
providing unsolicited information. 

If the data for each item tended toward an attractive e:ttreme for one 
occupation and an unattractive extreme for another (as intended), then the 
difference between highest and lowest scale position should have been a 
direct function of the importance attributed to the question. Hence, for 
each student who responded in a logically consistent way, the two should 
have been substantially correlated. 

The average correlation (using an r to ^ transformation) was .11 for 
the grade 9 sample and .28 for the grade 12 sample. Reasoning that students 
might use the attractiveness scale in some non-linear manner — in particular, 

that they found it harder to move as they ijent from the midpoint of the scale — 
scale positions were squared and correlations recomputed using differences 
between the maximum position squared an*d the minimum position saiiart:.d. This 
transformation of the data had little effect on the average correlations 

(average correlations = .16 and .29, respectively). Similar correlations 
were also found when, in place of the difference between high and low scale 
positions, the total distance moved in response to a question was used (aver-* 
age correlation = .05 and .12 respectively), (Total distance refers to the 
sum of scale positions across the three SOC occupations.) 

We would hypothesize that the students with high positive correlations 
were behaving in a logically consistent way and were good candidates to be 
labeled competent decision-makers, while the others — the majority — were not 
competent declslon-'makers . Thus^ some variation of these correlations be*- 
tween weights and moves for the various questions might well be treated as 
scores. They indicate the extent to which a student uses an item of Informa- 
tion about occupations in a way that is consistent with his values — I.e., 
the Importance he attaches to the dimension of information represented by 
that item. Indeed, a score based on this relationship appears in the next 
version of SOC. 

Interview Schedule 

The version of the interview used In tall 1974 appears as Appendices 
E £r F. Appendix G is the manual describing the scales and procedures for 
administration and scoring. 
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Characteristics of the Interview Scales 



Means and standard deviations for ninth- and twelfth-grade samples on 
the six Interview measures are presented In Table III-13. Notwithstanding 
revisions In the Interview, these findings paralleled the earlier ones. As 
before, the mean scores for twelfth graders were higher on all measures with 
the difference between the groups reaching significance for three scales — 
Constructs, Information, and Planning. 



TABLE III-13 

MEANS AND STANDARD DEVIATIONS FOR INTERVIEW SCALES, FALL 1974 

Grade 9 Grade 12 







X 


S.D. 


X 


.S.D. 


** 


Constructs 


13.4 


5.2 


17.3 


4.8 


** 


Information 


18.6 


5.5 


21.2 


5.9 




Keallty 


4.9 


2.4 


5.5 


2.8 


** 


Planning 


8.9 


3.5 


11.5 


2.5 




Control 


3.1 


1.0 


3.5 


.9 




Awareness 


17.4 


3.8 


18.0 


5.4 




** p <.01 











The Intercorrelatlons ibetween the six Interview scales^ based on Pall 
1974 data, appear In Table III-14, While the correlations were Renerallv mod- 
erate, they were higher thatt those obtained In the previous field test (see 
Table II-9, p. 29). Apparently, revisions In the Interview Increased the over- 
lap between scales. The Awareness scale In particular"' shows a great deal of 
overlap with four of the other scales (Constructs, Information, Reality, and 
Planning). 
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TABLE I I I- 14 

INTERCORRELATIONS BETWEEN INTERVIEW SCALES, FALL 1974 
■ (Grades -9 & 12 combined) 



Constructs Information Reality Planning Control Awareness 



Constructs 


1.000 










Information 


.39 ^ 


1.000 








Reality 


.36 


.46 


1.000 






Planning 


.40 


.44 


.50 


1.000 




Con trol 


.11 


.24 


.24 


.34 


' 1.000 


• 

Awareness 


.46 


.56 


.58 


.68 


.16 



1.000 



Correlations tjere also computed between the six Interview scales and the 
Items comprising these scales. The results are presented In Table III^IS. 
As Indicated In the table » the correlation between each Item and the scale to 
which It belongs was computed with that Item omitted from the scale. 

As would be expected, correlations between Items and the scales which they 
comprised were generally moderate. The only scale for which correlatl^s exceeded 

the •SO^s yas the Awareness scale, with which three Items h^d Intercorrelatlons 
In the .60*3. 

Comparing an Item's correlation with Its own scale to Its correlations 
with the other five scales s^ve an Indication of whether or not the Item was 
correctly placed. In general. Items appeared to be on the correct scale. 
There were, however^ some exceptions. ^ ^ 

/■ 

Constructs scale . Several Items on this scale were examined more 
closely: 

Item 1: '*Just about everybody works. But not everyone 
hopes to get the same rewards from work. What are 
some of the rewards, satisfactions^ (and so o\i) that 
you think people would like to get from working? 
Why do people work?" 

This Item had the highest correlation with the Awareness scale (.34) and 
a relatlvely^low correlation with Its own scale (.20). Since the Awareness 
scale had considerable overlap with the Constructs scale (ana. Indeed, with 
all the other scales, cxQept Control), this finding was not unexpected. Fur- 
ther, since the Item served as a warm-up and was Intended to Introduce the sub- 
ject of career decision-making. It was not surprising that students who were 
high In "Awareness" were more likely to be ready to respond to a question of 
this sort. 
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Item 3: "What might you not like about being a ' ^? 

, (List all the things you can think of that you might dis- 
like about It,)" 

This item correlated highest with the Planning scale (.36). However^ 
since it had a inoderate correlation (.25) with its own scale and was actually 
a companion question to Item 2 (one asked for "likes" and the other for "dis- 
likes"), it did appear to hz correctly placed . 



Item 22 (Information Test: Part A): * '^ame an occupation ; 
slml^r to the one you are presently considering. Write ^ 
three kinds of rewards or satisfactions that yoa could 
get from both your flrst^cholce occupiatlon and the one 
you just named. " 

<* 

Although this item had a moderate correlation with its own scale (.25), 
it had the highest correlation with Planning (.32). This was not surprising, 
slnc^ the question dealt both with constructs (listing rewards and satisfac- 
tions) and with planning (con&lderatlt>n of a second-choice occupation). It 
could be Included in either of these scales. 



Information scale. Unfortunately, the 21-ltem written questionnaire ^ 
(Part A) was scored as a whole, making Item-to^scale correlations misleading. 
In examining the two items from the oral interview which have been scored 
separately (Sb and 11), it did seem that Item Sb, which dealt with sources 
of information actually used and had high correlations with the Reality, Plan- 
ning, ^and Awareness sj^ales, should be eliminated. 

Planning scale > *As already discussed, there was a great deal of overlap 
between thi^ scale and the Awareness scale. Three of the six items "^tompris- 
Ing the scale had correlations with Awareness which were as high as or higher 
,thafti the correlations with their own scale. 

. 

Aw areness scale . As merftloned, the Awareness scale had high correlations 
with four of the five remaining scalS;?. The pattern of correlations indicated 
which items accounted for the dependencies. Since the Awareness scale seemed 
to add little that was^ not already covered by the other scales, it might be 
best to relocate items for this scale in accordance with items-to-qther scale 
correlations and eliminate it as a separate measure. 

An alternative wuld be to retain the Awareness scale using Items J>8i 19, 
and 21. These three items had the highest Item-to-scale correlations (.63, 
^61, and .65 respectively) and had relatively moderate correlations with each 
other* ^ The remaining five items on the Awareness ficale could be moved to those 
scales'^wlth which th^ had the highest corrQlations. - ^ 

Revision of Interview Schedule 

The interview schedule has been revised since the Fall 1974 administra- 
tion, even though it was not used in the tSprlng 1975 field test. The findings 
outlined in the previous section were taken Into^ account in refining this instru*- 
mentf (Prospective users are advised tO communicate with the authors to get 
copies of the most recent version of the Interview and Manual.) 
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Summary of Findings from Fall 1974 . , 

Major findings are summarized below: . 

t 

* » , 

" Relationships betveen*SOC scores and other 'putative 
criteria were low* The significant correlation that 
vas observed In the past between the distance measure 
ot SOC and the constructs scale of the Interview h 
diminished without an accompanying increased relation- \ 
ship observed between any of the other SOC scores and 
Interview measures. (See "SOC and Interview Corre- 
lations," p. 60') These findings can be Interpreted 

' In any or all of various ways: the criteria may have 

been Inadequate; the ?0C procedures or scores may have, 
failed In their purposes; SOC and the Interview may 
have tapped different components of competence In CDM. 

We failed to find a significant relationship between 
' the importance students attached to questions they asked 
and' their movements on the attractiveness scale* (See 
^^Relationship between Importance and Attractiveness^** 
— p— 64.") — Slnce-much-of-the-scorlng-of-SOC-waepredl-- - 

cated on the assumption that such a relationship 
should accompany competence In CDM» this finding 
needed further examination before another version of 
SOC could be developed* 

- The data we collected also allowed us to examine the 
manner In which students combine Information* Find- 

liigs^ Indicated that students were not behavlne In some 
f random manner but rather that they were giving thought 
to tlje task*(See "The SOC Model," p. 61*) Interviewers 
concurred and reported that students seemed Interested 
and Involved In the game* 

^ Many of. the student behaviors elicited In playing 
SOC remained pulte stable across the various ver- 
sions we tried. These. Included the kinds of 
questions askeil by stddents^ the' relative popularity 
of th^e occupajtlonal^ alternatives » both in terms of 
their selection by students and In computed deslr- 
abilities^ the high student Involvement In the task» 
and» to our chagrin^ the Idiosyncratic use of the 

' attractiveness scale* ^ 

In^Depth Iiitefylews 

' ^ These Interpretations of our fijidlngs from the^Fall 1974 version of SOC 
Indicated the need f of further study of students' understanding of the task, 
stijdents' use of the attractiveness scale, and the nature A SOC Information* 
All of these topics were explored through In-depth Interviews with students 
after the fall study was' CfoiiiQleted* 
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Out of these In-depth Interviews caioe a new version of SOC which was 
field-tested In the Spring of 1975, Highlights of these revisions follow. 

Revisions Based on Findings from In*Depth Student Ihcervlews 

The prepared SOC Information In the Fall 1974 version which was based on 
real occupations did not mean the sat^e thing to all students. For example^ 
an annual Income of $13»000 seemed high to some students and low to others. 
Rather than supply real Information In response to questions^ the Spring 1975 
version had students specify what they wanted (e.g.» Income) and how' much 
they wanted competed to most people In the future (e.g.» average). The In- 
formation they got gave the likelihood of satisfying their specification In 
each occupation. In this way the occupations were clearly differentiated 
along meaningful dimensions In^terms of the student*^ own specification^^ ^ 

Asking students to specify what tHey wanted In an occupation also solves? 
the pro'blem of students who found a medium amount of a characteristic to be 
most desirable (e.g. » average amount of leadership/responsibility). In the 
previous ^jjrslon they received three pieces of Information Indicating high^ 
medium^ and loif leadership/responsibility respectively for the three occupa- 
tions. Because thev wanted an average aioount^ they would have moved up the 
scale in response to an answer designed to be neutral* In the Spring. 1975 
version^ students specified a medium amount of th^ characteristic In the 
first place and the neutral ahsweif^ ^^posslble** produced a neutral re^ponse^ 
while *Very likely** :;Ilclted a positive response. Responses of **^osslble** 
and *Very unlikely** were d^fl^iied to suggest that opportunities are less than 
what was specified^ never more. 



When students were Instructed to ask questions about the occupations rather 
than formulate St>eclf Icatlons for what th^ wanted' In an occjiipatlon^ they some- 
times asked questions with no Ideal answer In mind. This respited In arbitrary 

use of the attractiveness, scale* Because students copld not make specifica- 
tions without stating an Ideal level or aibount in the Spring 1975 version-^ 
their responses to Infonoatlon were less arbitrary. 

In the past, the extremes of the attractlvenss scale were anchored by ab- 
solutes like **the greatest** or '*the worst.** This contributed to a celllnR ef- 
f ect"Students made smaller moves as they approached these absolutes. The new 
scale used the relative terms, **better*' and *Vorse.** 

.Complete freedom of movement of the markers also produced a celling effect. 
Usually the first information produced big moves and subsequent information 
produced smaller moves as the extremes of the scale were approached. It was 
decided that movement of the markers after the response to any one specification 
should be restricted to a maximum of three points up or down the scale so that 
the Impact of later information coul4 be Just as visible as the Impact of the 
first information. Given the mix of information, ^t Was impossible for a stu- 
dent to reach the extremes of the scale until unresdrlcted movement was al^ 
lowed at the end of each phase in Part 1 of the Spring 1975 version. ' 

It was found that using real occupations, even with ocrambled information, 
encouraged guessing ^nd thus distracted from the declslon^making P^oceeo. Xhe 
pew version used occupations of the future, and prevented assumptions about com- 
binations of qualities in any occupation. Overall desirability of the occupa- 
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tiDn Ma^ detemMed bv tUe deairabillty Qum^ not by the name of the occupation* 
Computtirion ol the ileslrabllity sum focused attention on the declslon-ioaklng 

It wa^ found thdt definitions of taaracteriatlcs used In the previous 
vetTSlon of SOC were COTfuslog^ particularly those of "interest field" and "edu- 
cation/* Ifordtng of the descriptive cards was revised to make the definitions 
clear and neutral* ; 

tile complexity of procedures used In the Fall 1974 ^erslnn of SOC and the 
tlDc required to administer the Instrument called for simplification and ab- 
brevlafim. fK number of . revisions were designed to reduce total administration 
ti^^ to DO mre tJian W ii:iinutes per student and to Insure that rll students un*< 
d*,-r6tood clearly what they vere doing* 



A full descrlptlc*Ts of the teyi5ied Paise follows under "SOC Procedu^Es^ 
A ^tjnpJv write^a^ <3f c*rio of the in»depth student Interviews Is Included 
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EXHIBIT III-l 

SAMPLE WRITE*-tfP OF IN-DEPTH INTERVIEW WITH STUDENT 

! 

Studeiit: M.6. » 18 years old» attended hi^gh schopl» no diploma 

Purpose: Further examination of nature of SOC inf^jnnation and use of scale 

Hypothesis: A student who is a good career-decision m^ker will ask 
questions related to the 10 SIGI values* When he is 
given unsolicited inforaation about the values which 
\ were not covered in his questions^ he will not change 

his ratings of the occupations. If his ratings do , 
change^ this is an indication that he did not ask the ' 
"right'* questions (for him) in 'the first place and 
that he is» to some degree^ a poor decision-maker. 

Procedure ^ , 

Int roduction. Put the student at ease. Find out where he is in school. 
Explain the game involves career decision-making and the data will not be 
used. Ask what student's first and second choice occupation miz^^ 

Part I. Student is shown the game board and told there are three tareers. 
He is to ask questions to determine which career is best for him. He-may ^sk 
as many questions as hevwl^shes. He is given answers from SOC information or 
from the interviewer for each question and the information accumulates on the 

game board for the three occupations. 

. ^ 

Part II. ' The student helps to label a 7*-pOint scale to be used in rating 
the occupations. The interviewer asks questions to help the student label the 
points on the scale such "If you saw the best ^possible^ career^ what would 
you call It?" To make sure that the student's labels are workable for him and 
that the extremes have the potential of being used» the student is asked to 
r^ame occupation which corrt^sponds to each point on the scale. He is then 
told to look at all the Inf aiffiation on the game board and rate the three occu" 
pations, using his scale. , ^ . ^ 

Part III, the interviewer gives t;he student unsolicited information aboi^t 
two of the three occupations^ those that received the highest ^nd lowest ratiogfi. 
The information corresponds to any of ten specified values vhlch were not covered 
in the studenC*s qliestions. The sCudent is asked» ^'Suppose I told you this about 
the occupations, how would j^ou rate them now?'* The interviewer puts a favorable 
answer with the lowest rated occupation and an unfavorable answer with the high*- 
e^t ^at<*d occupation. The student i^ tli^i told to forget that information, and 
Co suppose he were given inforniation about another value. He has th'^ chance to 
change hif5 ratings after each category of unsolicited information is revealed. 
\!h^Jt thit; Is complete<3, the student Is told the names ot the three occupations. 

Part IV. Mext the student is asked to rate the Impact that the solicited 
informntion had on him. First the interviewer helps iilm to label /--point 
scale and then each answer is raCed. 
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EXHIBIT III-l (contj 

Part V. t Using a prepared S-'polnt scale» the student Is asked to rate 
his self -gene rated questions In terms of their Importance as he now sees lt< 

Part VI. The' student reads and completes the SOC Values Rating Sheet 
(attached) . 



M . 's ?e rf ormance 



Introduction . M.B. Is 18 years old. He plays guitar with a j^z group 
and Is looking for a steady^ daytime job. His first choice career Is music; 
second choice^ art. 

Part I . M*B. asked ten questions^ abbreviated as follows: 

* 1. Manual (designing something with cne^s hands) 

2. Technical Knowledge Required 

3. Co-workers 

4. See End Product 

5. Meet People 

6* Use of Equipment 

7 * Hazards 

8. Indoors /outdoors 

9. Independence 
10. Unionized 

Bayt II , M.B. created the following scale to rate the three occupations: 

musician +3 moving 

newspaper reporter +2 exciting 

fiction writer +1 decent 

mathematician 0 so-so 

teacher -1 boring 

bank teller *2 predictable 

janitor -3 unchanging 

To the left are n^^^tis of occupations which M.B. felt corresponded to the scale 
positions. The three occupations were roted as follows: 



Occupation RatlnR 

#1 +1 

«2 *1 

#3 0 
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EXHIBIT III-l (contO 



Part III , Because occupation tf3 was rated between tfl and /f2, it was 
dropped from this part of the game* The following table shows the un-* 
solicited SIGI values^ the new ratings assigned for occupations 1 and 2» 
and the difference between the new and original ratings* 

Change from 

Unsolicited Values Occupation New RatinR Old Rating 



X 11 %d 


pr A, 

n 


0 
0 


1 




in 
n 


+1 
-1 


0 

0-" 


Helping Others 


n 
n 


0 
+2 


^* 


Security 


n 

n 


+1 
-1 




Leadership 


n 
n 


+1 
-1 




Education 


n 
n- 


0 
+2 




Leisure 


n 

fl2 ■ 


-2 

+2 





The information which elicited the greatest ratln;; chan^^es concerned Leisure 
(6), Helping Others (^)> and Education (A), Income (2> had some liKpact as 
well> but the other values resulted li^ no rating change^ and Mt^Vf* there- 
fore assumed to be unimportant to M*C* 

The Information for security should not have been f^lven ansollclted 
Infortftatlon , since M*B* had already asked about unions* 

P art ty * M*B* wa^; asked t^"> rate the impact of the angers to his 10 
original questions on the following: scale wJilch he h*>lped to create: 



3 






best 


2 






{v(-rv f^ood) 


1 






(good) 


0 






no impact 


^1 






(poor) 


-2 






(vr-ry poor) 
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EXHIBIT III-l (cont J 



The descriptors In parentheses were Included at firsts but later deleted 
when M«B« began to rate how much Information he had received Instead of Its 
Impact* The discrepancy was detected when he rated a "Yes" and "No" response 
the same way* It was felt that the deleted words had changed the focus of 
the scale* 

The table below shows the Impact scores by question and occupation* 



Question Occupation # Rat ine / 



r 



Manual 


1 


0 




2 


0 




3 


0 


- 

Tei!h Know 


I 


0 




2 ' 


0 




3 


+1 


r 

Co"Workers 


1 


-1 




2 


0 




3 


0 


See end prod 


I 


+2 




2 


0 




3 


0 


Meet people 


1 


+2 




2 


0 


,1 


3 


0 


Ubc of (»qulp 


1 


0 




2 


+1 




3 


+2 


llataxdf 


1 


0 




2 


-1 




3 


-3 


In/Ouc 


1 


+3 




2 


0 




3 


0 


Indt'p(*nd(?nc(5 


I 


+1 




2 


+2 




i 


-1 


Uit ionized 


I 


+2 




2 


0 




3 


-2 
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EXHIBIT III-l (contO 



The answers for "msnusl" had no Impact* M.B. Indicated that ''no manual labor» 
lots of writing'' would have been a good answer* He could not think of a good 
answer for "co^workars*" In tha first case he was expecting an answer to a 
broader question than he asked» nanely skills or abilities required* In the 
second case he seemed to be on a flahlng expedition^ vfth no expectations* 

part V* M*B* rated the Importance of his questions 'on the following scale 
prepared In advance; 



5 



4 Very Important 



.Absolutely Necessary 



3 Important 

2 — Fairly Impoiptant 

1 ^.^ Of Minor Importance 



The Importance Ratings for the self-generated questions are shown below* 

Question Importance Rating 

Co*Wotkers 4 

See End Broduct ^ 

Hazards 4 

Unionized ^ 

Technical Knowledge Requlrod 3 

Meet People 3 

tn/Out " ^ ' 3 

Indepf^ndencf? 3 

Rqulpm<*nt 2 

Miinual 1 

f*.irt VI * LlHted bi'low iktv Hi*? final rat In^h tlint M*B* «Hitlnned to tht* 
10 SIOI valuf^A on the Va\\}vH Riit Inn flhvet and thv n^t rimniir In M<B/» nrl- 
Klnal orcupJit Itmiil mtJnR*! prndarcd by unHnllc Jted valiii**! Intnrmiit Inn In _ 
Pfltt ni< WhiTp hyphonij Appo/ir, Inforii<iit im war not gi'vpn In I'nrr HI* 
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EXHIBIT III-l (cent.) 



Value 



RatlnR 



Net Change Produced 

by Values InfOi Part III 



High IncovK 


\ 5 . 


2 


Prestige 


1 


r 0 


Independence 


4 

* 




Helping Others 


8 


4 


Security ' 


2 


0 


Variety 


5 




Leadership 


1 


■ 0 


Interest Field 


4 




Leisure 


7 


6 


Early Entry 


3 


4 



We can see from this comparison that M>B* wad consistent In his rating^.* '^h» 
values which received high ratings produced some change In Part IXl* whJ]'' 
the law-rated values produced m change In Part III. 

r'o mnient s. When a atudent l^ks a*multlple-^]>art t]Ueatlon at the beginnJlnK 
of thr game»^B M,B. dld» It mlghC be wise to write flown the separate questltms 
and tell thejatudont that he can return to the others If ^^f" wlshta. OtherwUe 
the t{wntlrml may tie forgotten or thought unworthy by the ntudent* 

Worda asalgned to a scale have a large ^Impact on its uat by the stnde^t» 
an. sei^n In Parr IV. 

Pof thci mont part» M*D* wan nonnlittent In his ratlngA an seen In Port VL 
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CHAPtER IV 
FIELD TEST 3 (SPRING 1975) 



The .original goal for the second year of the SOC study had been to validate 
sue by means of a structured Interview. After questioning students prior t* 
the Spring 1975 study, we realized that a less ambitious goal was In order. 
Procedures had to be refined to make^^C -easier and quicker tfo administer be- 
fore Its validity could be tested, it was also necessary to develop more 
specific operational descriptions of a goc -^areer decision-maker before taking 
steps to validate those measures. Finally, *ores that could have diagnostic 
meaning had to be developed. In order to devote all remaining time to those 
primary purposes, the structured Interview was deleted from the Spring 1975 
field test. 

. 

Forty minutes of each student's time were required for the SOC administra- 
tion. Time was allowed at the end of that period for feedback and discussion. 

Description of Sample 

One of the 3 high schools In the previous sample participated In the ' 
Sprlttg 1975 field trial of SOC. Orte week before th^ trial began, two Inter- 
viewers went to the school to talk to the students. Heterogeneous 9th and 12th 
Krade classes were selected as the target groups. Each ftrade was divided Into 
expcrlmentals and controls. ■ 

Tin* 9th and 12th grade control groups were told briefly about the gam^ 
and wei'e given parental permission forms with accompanying letters. The ex- 
purlmental Rroupa from hoth grades were told about the ^amc li> more detail 
and partlclpatod In a ^0-*mInutf> discussion of occupational characteristics* 
Th*?y too were t'.lven pt^rmlMiqilon fonD*^. Seniors over 18 Btp,ned for themselves. 

KxhlhltH IV-1 and for outlines of prcaijntat Ions to both groups 

and Jor the l**tti'r to parents.) j 

r^tuiIentM roturneil i^i'mlMwlon, forms to tli<? schooll .*ind were contacted at 
r.indoni. Final ^t^locMon was miidc on the basis of ttlc\r availability. Of 
.tpprr.xlmitti'lv 375 f.tudciiCH who received it'tters, 10^ rctumod p<eitmlstiIon 
formf^. Of Un?so> ftO actually pl^qyed thi* ^^)C i\imv$ 15 In Gcxch group. Table 
IV'-l jdmwrj thi* numlna i>f students la each f?,roiip who agreed to participate I'and 
till* nnmher Kv .u^k who jictti^Uv participated In the ettndv. 

^;t^ladardf^^'d tofit fjoor^^i of all Part Iclpat fiif^ ri^ntf^ ^k^tc rt^viewed. 
Thrri^ wore no differences between 9th and f'.raderu (relative to appropriate 

K.r.ide nonsuO nr bi^twi'im e:^|>(*rlm<^nfal and ronti't^lt^ aw meatiured fjtrtndarMzed 
tt-uit\ nf verbal rthlHfy {p>.')'j). 

All ?itud**ntrt Were admfnf fjti-rud ^hc nam* ver^i^vi of S-^C <in deticribed in 
tUi^ lollow)t\^r ti<.*etlon. The p<irpn?Air of dlvUUtiK them Into experimental at^d 
emttro! >':nmpft wat^ to m^r uheMiei ^erv brief "coachlnj^ for the to^t" woiild 



90 

ERIC 

ExhlbTtH are Included t\t the <*nd of the chapter. 



TABLE IV-1 
DESCRIPTION OF SA^^PLE, SPRING 1975 



9 th 



12th 



Girls R'^ys Tota l Girls. Boys Total 



No« Agreed 
No* Coatpleced 



25 

I 

8 15 



40 
15 



CONTROL 



9th 



12 th 



Girls Boys Total Girls Boys Total 

21 ■ 18 

8 7 15 5 10 15 



I 

•■o 

I 
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make a difference In perfoxftanrce* We had wondered whether estudents weriB un* 
duly hampered by being asked to fotmulate specifications on the spot# within 
ten minutes* Could they be expected to hahdlfe this assignment as well a^ If 
they had been given advance notice and an opportunity to deliberate on the 
V task at their leisure? ^ 

Findings sfiowed no marked differences between experlmentals and controls 
jim any dimension measured* On the average, both groups named the same ni:mber 
of specifications, indicating that the ten-minute time restriction did not * 
hamper student performance* Xt should he noted,' however, that the amount of" 
intervention with the experlmentals was minimal, because of time restrictions 
at the school* Given the short and informal nature of the intervention and 
the apparent lack of student Inyolvement Ind preparation, the similarity he- 
tween the tw9 groups was not surprising* The pos§lble;ef fects of a stronger 
or more extensive intervention are not to be Inferred from this experiment* - 

SOC Procedures. SPrlnRJL975 

' Interviewers administered S^C to students individually* Each student 
had 40 minutes to complete the game* 

Introduction - ^ 

K 

^The student was told that he was about to play a' game designed to test 
how good he was In making career decisions* 

In this game, th** i^tudent had to choose which one of three occupations 
was best for him and decide which one was worst*' The three occupations, X» 
Yf and Z, were occupations of 'the future rather than present-^day occupations* 
This discouraged students from guessing the names^of the occupations and from 
* assuming that certain characteristics went together* 

« 

The srudenf had to specify what he wanted in order to get information « 
that would help him select the best and avoid the worst occupation* He was 
told to specify the things that?^ were most important to him in choosing an oc- 
cupation — ^not a particular lob in the occupation, but the occupation as a 
whole** 

In order to Illustrate what was expected* the Interviewer asked the 
student to make specifications about the kind of .car he would like* Examples 
\f apetrif Icatlons were given by the interviewer if necessary* Also, the 
stt!dent wss shown a sample information strip similar to the one he would see 
later- 

The student was then given a few minutes to write his occupational specl- 
f Icatloiia* ^ 



ft , / 

Occupations name hro/id citegorief* of worknrs «uch as hank tellers, physicians 
welders* modcU^ or newf;.paper reporteri** Within each occupation thprc are 
thousands of John* For example, a welder may have a Job In a shipyard or a 
factory or he may be welf-employed and have his own shop* We were not con^ 
ccmed wl*h particular ioh^ In this game* Instead we were talkln^t about ac** 
cupatlons as a whale — all bank tellers, physicians, welders* etc* 
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Part'I — ChooslnR an Occupation i ' i '- 

' / ■ 

Phase 1 . The student made hls^flrst specification and was given an 

Infoi'matlon strip containing the specification and information for all three 

occupations. 



Specification 



Y 





("Very likely" was colored green, -arvd "very unlikely" was colored red.) 



The Infomatloit' strips were prepared in advance. Favorable, unfavorable! 
and neutral information were spiraled sa that the student would get a combi* 
nation of responses for each occupation. The purpose was to simulate real- 
life choices wherein one value was pitted against anotherw^The specification 
area on some strips was blank so that the interviewer could wrj,te a specifl-. 
cation in the student's own words when necessary. On the strip shown above, 
"Income" appeared the prepared strip but the words, "above average" were 
written in by the interviewer in accordance with the student* s specification. 
If the student had specified avetage lacome, the word, "average" would have 
appeared Instead* 



The student was given a scale on whl,,ch to record how he felt about the 
three occupations on the basis of the Infondatlon received. Each occupation 
had its own scale and marker. The scales ran from +15 to -15, with 0 ae the 
point of indifference. Everything above 0 was better than Indifferent and 
everything biilow wafj worse. (See Exhibit IV-3) 

The markers were placed at zero initially. The studmfc could not mo;'e 
the markers more than threes polntd up or down the scale in any one move. 
This prevented him from reaching the top or bottom of the ^pcale before all 
the infonitation was revealed. The student made his first ratings, which the 
interviewer recorded, and he then made a second specification. 

The information strip for each new specification was» placed on top of 
the previous strip. The student rated each information strip separately and 
the Interviewer recorded all scale positions. ^ 

The student was allowed 10 minutes from the beginning of Phase 1 to. make 
specifications, get Information, and use the scale?. If the student's speci- 
fications were unclear, the Interviewer probed to find out exactly what the 
student had in mind. 
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Wtien thQ student exhausted his specifications or when time ran out» 
the strips were spread out so the student saw them all at once. He was 
told to make an overall rating to show how attractive or unattractive he 
found each occupation. This time he could use the whole scale for the 
rating; he was not restricted to moves of 3 or less. At the end of Phase 
If the Information strips' were removed and the markers iJ^re returned to 
zero. * ^ ^ ' 

Phasg 2, The Interviewer gave the student an opportunity to select 
addltioi^al characteristics, extrinsic rewards and Intrinsic satisfactions 
of thtL occupations. The student looked over descriptive cards which had 
names of Characteristics on one side and definitions on the other. (See 
Exhibit The number of cards depended on the number of characteristics 

previously specified; cards relating lo those characterlstlcs^were not In** 
eluded. The student selected the three characteristics which he felt were 
most important for him to know about. 

Information strips for each characteristic were Riven as thev were In 
Phase 1; each new strip was placed on top of the old one. The student was 
again told to place markers on the scales with the restriction of no more 
than 3 points per move. ^ 

At the end of Ph^e 2, the three strips wore shown together and the ' 
studeitt made an overall rating^ using the i^olo scale as did at the end 
of Phase 1. The markers were then returned to zero. f_ 

Mexfr, che*3tudent was shown *a 11 the Information from Phases 1 and 2 
at the f^ame time. He was asked tb make a finals overall rating based on 
all the Information he then had. Again, he could use the whole scale. (See 
Exhibit IV-5 for exan^sle of information whldt a student mi'ght see*) 

Part tI"Evaluatlon of Decision 

Phase l\ The student was told that his choices would now be evaluated.^ 
He was given descriptive cards which corresponded to all of ^he specifica- 
tions that he Initiated In Phase 1» plus the three characteristics that he 
selected In Phase 2 of Part I* In addition he was given aijy remaining cards 
which described extrinsic rewards and Intrinsic satisfactions of occupations. 
(There were nine such cards*) 

1? ' 

The student wd<i ai^ked ;:o sort the cards Into three plies according to 
how Important it was for him to. have a satisfactory amount or lev^l of eoch 
characterlst ' One pile was for characteristics t*at were very ImpQrtanc 
to satisfy^ ^<ti? for thm^ that were less Important, and one for those that 
wvts; least Important* 

The student then sorted the cai^ds into pockptB on a scgle from 0 to 8* 
(See Exhibit IV-6*) He^ could have no more than two cards in pocket" 8* The • 
The weights which the student asslgnet^ to the characteristic In this ^r^y 
were recorded. * \ 



Phase *2 . The student'acocctipatlbnal choice was evaluated. First the 
Defeirabilitjr Sum Worksheet, (Exhibit IV-7) was used to compute relative desira- 
bilities of the occupations. ^ 

The weight >hich was assigned by jthe student to show the importance of 
Mch characteristic was multiplied by the instrumentality of the information^ 
spaled as follows: very likely " 3, 'possible " 2^ very unlikely - 1. The 
products were added. ' The sum of the products^ called a desirability sum» was 
obtained for each occupation at different st;pges in the game. Characteristics 
describing rewards and satisfactions which were sorted on the importance scale 
but were not part of the informe|tion seen by the student were listed under 
*'other characteristics." They v^re used in computing an ideal desirability 
sum^ i.e.^ the desirability of an occupation if all information about rewards 
and 'satisfaction^^ had been known. Characteristics weighted less than 4 (''mod- 
erate importance *')wer'^ not used in computing desirability sums. 

The desirability suins w^re ^entered on the SOC Recording Form (Exhibit IV-8) 
ihe interviewer compared ""the des'^irability sum with the student's ratings of oc- 
cupation3 at each staf^e. , (For a complete description of the use oJ^ recorjing 
forms^ see the next section entitled "SOC Materials.*') 

The interviewer also pointed out the ^tudent^s strengths and weaknesses 
in processin^^ information. He noted the number of specifications made by the 
student. The number ranged from a low of 2 to a high of 6, in the time al- 
lowed, (students who made many specifications generally had a* clearer pic- 
ture of what*'they wanted in an 'occupation than students who made fewer specifi- 
^^ations. ) 

The interviewer al^o looked at the weights which the student had assigned 
to different] characteristics to see whether the student knew what was Impor- 
tant to him .in an occupation before the game be^an. Ideally the student's 
^specifications are weighted mbst heavily, followed by the characteristics 
chosen in Part It Phase. 2. The uncho5ten characteristics should receive the 
lowest Weights. Deviations from this nattem were discussed by interviewer 
and student. | ' ^ . 

The interviewer al^o pointed out that students should logically move the 
markers in'.a way that i^ consistent with the weights they have assigned to a 
given characteristic* That i^^- the distance between the marker Positions 
for the occupation that, is "/ery likely*' and the. one that is "very unlikely" 
should vary directly wit;h the weight nf th^ characteristic* 

After receiving feedback on his performance, the student |had a chance 
to make comments and asK questions about the game. 

^ . i 

SOC Materials { 

't I ■ 

The gome materials Included: (l) des<^riptive csrds^ (2) display label 
and information sjffip^, j(3) two rating scales^ (4) recording forms, (5) SOC 
scrint. and (6) Suld^lncs for administering SOC^ 



Dcscrlptlvg Cardg (Exhibit IV-4) . Cards describing rewards and sat- 
isfactlons^ required abilities^ and certain working conditions were used 
by students In assigning weights to characteristics. The cards describing 
rewards and satisfactions were also u^ed for presentation of unsolicited 
Information. Each 3** x S*' card had the name of a characteristic on one 
side and a definition on the other. 

/Rewards and 'satisfactions had been Identified In previous research 
[Norrls & Kat2» 19701. Abilities vere Included because students sometimes 
specified abilities required as well as Interest field In Phase 1. Two 
working conditions were Included as 'well» since they too wc^re soof^tlmes 
specified. While most worklnR condiftiohs are job-speclflc, ^'travel*' and 
''physical surroundings" were Judged ^^Ikely to be occupational In scopes. 

: Dlsjxlay Label end Information ?ttrlps^ (Exhibit iy"9)_. The dla« . 
play label was a plecti of cardbc^d under which the Information strips were 
allgiled. It labeled the parts of the Information strip: "Spec." (for 
specification), and "X," *'Y," and "Z'* for the three occupations. 

information strips contained characteristics and Infonnatlon about the 
three occupations. Tn some cases the specification box vas completely blank, 
so that the student's languHf^e could he used, in all cases there was room 
to write In the amount or level desired; 

The characteristics on the Information *itrJps corresponded to those on 
the descriptive cards. Iiiformation about tire three Occupations was prede* 
tennlned so that nono of the three occupations %jo\ild be universally attrac- 
tive or dismal^ and yet the configuration o( Information woti^d not he bla*^ 
tantly lackinR In verisimilitude. ThiAft, an equal 'number of positive and 
lo^lcallv "conf^enlal^^* charnot'^rlsttcs were clustered In each oc^ ipat!ont 
alonr with equal numbers of negative and neutral characteristics. (See 
Exhibit lV"10t) The numbers under each occupation represented thct 
Instrumentaljity of Information scaled ss fDllows> ^ ■ very Ukelv (cnlorecl 
green), 2 * possible, and 1 » very^unliki?lv, tcislored red). 

Attractiven e ss Scaie (Exhibit lV-*3 j . To tate the attractiveness of the 
three occupations, students moved markers vepvesent iHf; the occupations nlong 
an attractiveness sc?il(?7that ran from ^15 tn -15^^ Tht; midpolntt 0, wa^ 
labeled "indifferent.*' Other labels Indicated that as the narker went np, 
students f^U better about the occupatlan j^rA as it mo\red d(nm ihev felt 
worse. 

I mportance Scale fExhlbtt tV-*fe) « lo ^how the r4>I^tJve it^portance of 
their so**clflcAtlonR and other Ihtrlnslr rewards and ?;atlitfacc Ions, students 
used a second scale, consl^tlnf^ of Pocker^t which rfltt fr^^m 0^ of no tmpor- 
tvince^ to 8, of ^^,rente**t Importancts 

Recording. Forms (tvxh l ^Ua fV*7 & 8>. The snr (0-coriilng ^om^ l^xhlt^it 
IV^^^ had three raior sectiovis for Phas/^ H ^hasv ?t an^, final rjttlnif.^ ^ind 
desirability stum^. ^ Ar ^ip^'clf Ir^attons wi^rt' maHe in J^tta^frf* 1 and ?* they 
were riicr^rccd^ together wfth the *icale powtttots^. Ov^^ifall rat4«>?ft were re-- 
corded at the fnil of Pba^e 1 nnd Phasif 2- A final r/ifln|flt ft^r aU Infnrma* 
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tion was recorded in the third section* Desirability sums were computed on 
the Desirability Sum Worksheet and entered on the recording form next 
to the ratings , 

The Desirability Sum Worksheet, Exhibit. IV-7, recorded the 
characteristics which were specified, chosen, or not chosen, together with 
the weights assigned by the students. One column under each occupation 
showed the instrumentality of each item of information given to the students, 
scaled as follows: "verv likely" = 3, "possible" = 2, and 'Very unlikely" = 1. 
The product was the student's weight multiplied by the instrumentality 
of the information. Desirability sums were computed for Phase 1 and Phase 2, 
The cumulative desirability sum was the sum of Phase 1 and Phase 2 desir- 
ability sums. The ideal desirability sum was the cumulative desirability 
sum plus products of characteristics which were not chosen or specified by 
the student. Characteristics assigned a weight less than 4 were not in- 
cluded in computing desirability sums* 

SOC Script (Exhibit IV-11). The script was read by the interviewer 
to the student as they went through the game* It also contained directions 
to the interviewer. 

Guidelines for Administering SOC (Exhibit IV-12) . The guidelines con- 
tained directions on ho[<r to classify specifications and which information 
strips to shcjw the student in response to specifications. 

Average Ratings and Desirability Sums for the SOC Occupations 

Though fictional, the SOC occupations were designed to simulate real-^ 
life occupations with an equal balance of attractive and unattractive fea- 
tures. In addition, some thought was given to shaping the features of the 
three SOC occupations to different kinds of students. To investigate that 
prospect, an analysis was undertaken to find out whether the value profiles 
of students from Spring 1974 could be classified according to some 
typology. The method used was a cluster analysis [ Gruvaeus & Wainer, 1972] , 
which revealed that profiles did not cluster. Thus, students could not be 
classified in such a way as to construct occupation profiles that would match 
student tvpes. 

Since students rated the SOC occupations, we can see how successful 
we were in developing three occupations that balance attractive and unat- 
tractive characteristics so that none would be universally desirable to stu- 
dents nor unrellevedly abhorrent. Thus, students^ choices would not be a 
foregone conclusion, but would be a function of complex interactions between 
their own values and the occupational characteristics. 

Table IV-2 shows the mean ratings across all students for the three oc- 
cupations at the end of Phase 1, Phase 2, and overall. On a 31-point scale 
(from 0 to +15), the ratings were very close, ranging from 2 to All 
ratings were positive, indicating that the occupations were all somewhat 
attractive. The standard deviation ranged between 5.2 and 6.0, so that no 
one occupation emerged as being universally more desirable than the others. 
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TABLE IV-2 
MEAN RATINGS OF SOC OCCUPATIONS 

Occupation Phase 1 Phase 2 Overall 

X 4.0 ?..2 4.5 

Y 2.0 3.0 3.0 

Z 4.4 3.6 3.5 



Like the ratings, the desirability sums for the three occupations fell 
quite close together. Table IV-3 shows the mean desirability sums across 
all students for the three occupations at the end of Phases 1 and 2 as well 
as the cumulative and ideal desirability sums. The standard deviation was 
between 10 and 20* 



TABLE XV- 3 

MEAN DESIRABILITY SUMS OF SOC OCCUPATIONS 

Occupation Phase 1 Phase 2 Cumulative PS Icieal PS 

X 53.7 32.8 86.4 98.7 

1 49.1 32.8 83.1 92.6 

Z 51.0 34.6 85.6 97.6 



Frequency of Selection of Each Occupation in SOC Game, SprinR 1975 

Table IV^4 shows the frequency with which all students selected occupa- 
tions X, Y, and Z at the end of the game. 

Despite the overall comparability of the three occupations in terms 
of ratings and desirability sums, occupation X was most frequently selected 
by all students (47%). Occupations Y and Z were chosen with about the same 
frequency (25% for Y and 28% for z) . 

Ninth graders selected Occupation X nearly one-half the time (47%). 
Occupation Z was second (37%). Occupation Y was selected least often (16%). 

Like the ninth graders, the twelfth graders selected Occupation X most 
frequently (47%). Unlike the ninth graders, twelfth graders selected Occu- 
pation Y (33%) more frequently than Occupation Z (20%), 
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TABLE IV-4 

FREQUENCY OF SELECTION OF EACH OCCUPATION IN SOC GAME, SPRING 1975 





Occupation X 


Occupation Y 


Occupation Z 1 


Grade 9 


47% 


16% 


37% 




<14) 


<5) 


<11) 


Grade 12 


47% 


33% 


20% 




<14) 


<10) 


<6) 


TOTAL 


47% 


25% 


28% 




<28) 


<15) 


<17) 



^ A possible explanation for the popularity of X may be its high instru- 
mentality rating on **Incoine," which was the most common characteristic speci- 
fied by students. 



The ''Desirability" of Occupations "Chosen" 

Table IV-5{a) shows, by grade, the percentage of students whose occupa- 
tional choice at the end of Phase 1 (after self-generated specifications and 
before unsolicited information) was an occupation with the highest, second 
highest, or lowest desirability sum. 



None nf the 
Over 3/4 



le students chose the occupation with the lowest desirability 
of all students (77%) chose the occupation with the highest 
ability sum. Freshmen were more likely (83%) to select an occupation 
the highest desirability sum than were seniors (70%), 



Table lV-5(b) shows, by grade, the percentage of stU£i-..^o whose occupa- 
tional choice at the end of Phase 2 was an occupation with the highest, 
second highest, or lowest desirability sum* The choice at the end of 
Phase 2 was based on information about three characteristics selected by 
the student. Previous occupational information was temporarily ignored. 

At the end of Phase 2, 79% of all students chose the occupation with 
the highest desirability aura. More seniors (83%) than freshmen (73%) chose 
the occupation with the highest desirability sura. However, two of the 
seniors chose the occupation with the lowest desirability sum. None of 
the freshmen did so. 
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Table IV-5(c) shows students* choices at the end of the based on 

cumulative and ideal desirability sums • The cumulative desirability sum 
is the sum of Phasja 1 and Phase 2 desirability suras • The ideal desirability 
sum is the cumulative desirability sum plus the sums of products for rewards 
and satisfactions which the student did not specify in Phase 1 or select in 
Phase 2* 

Freshmen (93%) were more likely to choose the occupation with the high- 
est cumulative desirability sum than seniors (87%) • Freshmen and seniors 
did almost the same (83% vs. 80%) in choices compared with the ideal de- 
sirabilitj^ sum. In making a final choice, one senior chose the occupation 
with the lowest cumulative and ideal desirability sums. None of the fresh- 
men did so. 

Overall, the percentage of students selecting the occupation with the 
highest cumulative desirability li:. eased from 77% at the end of Phase 1 
to 90% at the end of the game. 

When we compare Tables IV-5(a), (b), and (c) to Tables III-3(a) and 
III-3(b) of the Fall 1974 study, p. 53, we see that up to 20% of all students in 
Fall 1974 chose occupations with the lowest desirability sum compared to 
none in Spring 1975. This may have been due to changes made in the SOC 
game wherein real occupations and real information were replaced by occupa- 
tions of the future, and standard information ("very likely," "possible," 
'Very unlikely") was given in response to specifications. Therefore it 
seems that information in the Spring 1975 version made desiiability of oc- 
cupations clearer to the students. For example, students in the fall study 
could interpret a piece of information such as "may direct one or two other 
employees" as' favorable or unfavorable. In Spring 1975, a rational student 
who specified "an average amount of leadership'* would have to interpret a 
response of "very likely" as favorable and "possible" as less favorable • 
Also information could be synthesized more easily because of the faces and 
color coding on the answer strips • 
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TABLE IV-5(a) 



FREQUEWCY WITH WHICH OCCUPATIONS AT VARIOUS LEVELS OF DESIRABILITY WERE 

CHOSEN AT END OF PHASE 1, SPRIWG 1975 





Desirability 


Desirability 


Desirability 


Grade 9 


(25) 


17% 
(5) 


0 


Grade 12 


70% 
(21) 


30% 
(9) 


0 


Grades 9 & 12 
Total 


77% 
(46) 


23% 
(14) 


0 



TABLE IV-5(b) 



' FREQUENCY WITH WHICH OCCUPATIOHS AT VARIOUS LEVELS OF DESIRABILITY WERE 

CHOSEN AT END OF PHASE 2, SPRING 1975 





Highest 
Desirability 


Second Highest 
Desirabili ty 


Lowest 

Desirability 


firade 9 


73% 
(22) 


. 27% 
(8) 


n 


Grade 12 


83% 
(25) 


10% 
(3) 


7% 
(2) 


Grades 9 £. 12 
Totals 


79% 
(47) 

1 


18% 
(18) 


3% 
(2) 
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TABLK IV-5(c) 



FREQUENCY WITH WHICH OCCUPATIONS AT VARIOUS LEVELS OF DESIRABILITY WERE 

CHOSEN AT END OF GAME, SPRING 1975 
(Based on Cumulative "Desirability Sums) 





Highest 
Desirability 


Second 

Highest 

Desirability 


Lowest 

Desirability 


Grade 9 


93% 
(28) 


7% 
(2) 


n 


Grade 12 


87% 
(26) 


10% 
<3) 


3% 
(1) 


Grades 9 & 12 
Totals 


90% 
(54) 


8% 
(5) 


2% 
(1) 


(Based on Ideal Desirability Sums) 




Highest 
Desirability 


Second 

Highest 

Desirability 


Lowest 

Desirability 


Grade 9 


83% 
<25) 


17% 
(5) 

1 


n 


Grade 12 


80% 
(24) 


17% 
(5) 


3% 
<1) 


Grades 9 & 12 
Totals 


82% 
(49) 


16% 
(10) 


2% 
<1) 



-91- 

Comparin^ Types of Specifications Most Frequently Made by Ninth and Tvelfth Graders 

In Phase 1 of SOC, students were giver, ten minutss to generate specifica- 
tions about occupations. Table IV-6 gives the frequencies and rank order of 
these specifications for ninth and twelfth graders. 

From Table IV-6 we see that the top-ranked, self-generated specifications 
are the same for both ninth and twelfth graders: "income," "security," "variety," 
"helping others," and "leisure." (Also^ if the tally for the three interest 
fields were combined, "interest field" would rank among the top five for both 
ninth and twelfth graders.) 

Table IV-7 compares the top-cranked characteristics (specified by 8% or 
more of the sample) from the Fall 1974 study to those from the Spring 1975 
study. "Income," "interest field," "leisure^" and "variety" were among the 
characteristics most frequently specified by 9th and 12th graders in both 
studies. 

"Physical surroundings" were mentlonea frequently in the Fall 1974 study 
but not by the Spring 1975 sample. This may be due to a stricter policy by 
interviewers in Spring 1975 of not responding to specifications that were 
appropriate only for jobs rather than occupations. 

^'Helping others'" and "security" were ranked higher in Spring 1975 than 
in Fall 1974. Perhaps students were more conscious of security because of 
increases in unemployment. 

At any rate, it seems clear that these lists comprise a finite universe 
of specifications that students generate. This definition of the list en- 
ables us to anticipate almost any specification that a student will generate 
and to be prepared with appropriate information — i.e., relevant to that 
specification — for occupations X, Y, and 2. 
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TABLE IV- 6 

TOPICS OF SELF-GENERATED SPECIFICATIONS, SPRING 1975 

9th Graders (30) 12th Graders (30) 







f 


% 




1 


% 




Income 




25 


20 


1 


25 


20 


1 


Security 




10 


8 


3 


13 


10 


3 


Variety 




10 


8 


3 


15 


11 


2 


Helping Others 




11 


9 


2 


12 


9 


4 


Leisure 




10 


8 


3 


15 


11 


2 


Leadership 




7 


6 


4 


7 


5 


5 






7 




A 

H 


Q 


A 

H 


/; 


XII I CO U r XcXQ 


#1* 


7 


Q 




(L 
u 


A 


Q 


Education 




4 


3 


7 


7 


5 


5 


Prestige 


n 


5 


4 


6 


7 


5 


5 


Interest Field 


6 


5 


5 


3 


2.5 


8 


Interest Field 


#3 


6 


5 


5 


3 


2.5 


8 


. ^ .r^ **** 

Ability n 




4 


3 


7 


4 


3 


7 


Ability n 




2 


2 


9 


1 


1 


10 


Ability #3 




3 


2 


9 


2 


2 


9 


Work Set 




3 


2.5 


8 


3 


2.5 


8 


Travel 




2 


2 


9 


3 


2.5 


8 
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Interest Field #1 Includes scientific, verbal, business and admini- 
stration fields* 

kk 

Interest Field //2 is the personal contact field. 

Interest Field ^^3 includes technological and artistic fields. 

Ability //I, #2, & 3 refer to a high level of ability required in 
working with data, people, and things respectively. 
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TABLE IV-7 



CWMPARISOH OF SELF-GENERATED SPECIFICATIONS MADE BY STUDENTS 
(8% OR MORE), FALL 1974 AND SPRING 1975 

Fall 1974 



9th Graders 



Income 14% 

Physical Surroundings 13% 

Interest Field * 12% 

Leisure 9% 

Variety 9% 

Education 8% 



12th Graders 



Interest Field * 15% 

Income 13% 

Physical Surroundings 11% 

Education 10% 

Leisure 8% 

Variety 8% 



Spring 1975 



9th Graders 



I'^th Graders 



Income 

Interest Field 

(combined) 
Helping Others 
Variety 
Leisure 



20% 

16% 

9% 

8% 
8% 



Income 
Variety 
Leisure 
Security 
Helping Others 
Interest Field 
(combined 



20% 
11% 
11% 
10% 

9% 

9% 



In the Fall 1974 administration, "interest field" included all interest 
fields. For purposes of comparison, the three interest fields were com- 
bined in the Spring 1975 data. 



ERLC 



1 J5 



-94^ 



Description of SQC Measures 

In appraising a student's competence In career decision*making> we have 
defined as criteria the extent to which the student knows what information 
he needs» can get the information he wants, and can use the information he 
has- While these competencies are logically sequential, the behavior in 
which they appear may provide indices of more than one at a time* For ex*- 
ample, as indicated below, the nature of the student's own specifications 
can yield observations of more than one competency. Nevertheless, the three 
competencies defined are useful as logical categories for describing the 
measures * 

Knowing what information he needs > The good career decision-maker (CDM) 
can specify all the characteristics that are most important to him in an oc- 
cupatlon* One way to measure this is to see how many of a student's three 
top-weighted characteristics were specified in Phase 1. This measure is re- 
ferred to as TOP VAL > The CDM who knows his own values should, of course, 
specify in Phase 1 all three of the occupational characteristic;? that are most 
important to him as indicated by the weights he assigns later to all charac- 
teristics • 

A second way to see whether the most Important characteristics were gen- 
erated by the student in Phase 1 is to look at the ratio of the average 
weight assigned to characteristics in Phase 1 and the average weight assigned 
in Phase 2. This measure, referred to as W 1/2 , shows whsther self-generatod 
specifications were seen as more or less important than characteristics se- 
lected later • The ratic for a CDM who knows his own values will be greater 
than one. 

A third measure, N_o£^CS^, is the number of Specifications generated in 
Phase 1* A CDM who knows what he needs can be fluent and explicit about it, 
and therefore will tend to make a relatively large number of specifications 
within the time allowed. This measure might be expected to verge also into 
the next category, since fluent and explicit specifications are also instru- 
mental in getting information. 

Based on a similar principle, a fourth measure, H PROBES , is the number 
of clarifying questions used by the interviewer to help the student frame a 
mutually understandable specification in Phase 1. For example, if a student 
made a subjective specification such as, "I want to feel useful," a probe 
would ask the student to specify something about an occupation that would 
make him feel useful* The use of probes was governed by specific guidelines 
for interviewers, indicating when and how probes should be used. An in- 
vestigation as to whether interviewers varied in number of probes showed no 
significant differences between interviewers. Since a CDM who knows his own 
values and is also competent in getting information will state specifications 
which are unambiguous and which are Isomorphic with characteristics of occu- 
pations, the smaller the N PROBES score the better. Thus, we would hypo- 
thesize that N PROBES would be negatively correlated with the other scores. 
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Getting the information he wants * As indicated above > N SPECS and 
N PROBES overlap the previous category ("knowing*') and this one ("getting"). 
Another measure for this category comes from Phase 2. These students have 
an opportunity to select characteristics of occupations about which they 
would like information. A measure of how good the student is at getting 
the information he wants is the ratio of the average weight assigned to char- 
acteristics in Phase 2 and the average weight assigned to "other character- 
istics^" those not selected in Phase 2. This measure is referred to as 
W 2/3. It indicates competency xn identifying and selecting characteristics 
of importance, quite independent of ability in generating or initiating 
specifications » as a means of getting relevant information. However, a high 
TOP VAL and a high W 1/2 along with high N SPECS might tend to preclude a 
high W 2/3. 

Using the information he has . Several measures show how well the stu*- 
dent is able to apply information to the process of discriminating between 
occupations. The standards for comparing each student^s ranking of occupa- 
tions are their desirability sums, which combine what the student wants with 
what the occupation offers, providing an index of utility. The desirability 
sum (DS) for an occupation is computed as follows: The weight a student has 
assigned to each characteristic (0-8) on the importance scale is multiplied 
by the instrumentality of the occupation for that characteristic (instrumen- 
tality reflects the capability of each occupation for meeting a student's 
specification, scaled as "very likely" = 3, "possible" = 2, and "very un- 
likely" =1). DS for each occupation is the sum of these products. Char- 
acteristics weighted less than 4 are disregarded in the computation of DS 
because they are considered by the student to be of less than moderate im- 
portance and therefore should not influence the overall desirability of an 
occupation. (See DS IJorksheet, Exhibit lV-7*) 

Phase 1 DS's are based solely on characteristics specified in Phase 1. 
Phase 2 DS's are based solely on characteristics specified in Phase 2. Cumu- 
lative DS's are the sum of Phase 1 and Phase 2 DS's. The Ideal DS's are the 
cumulative DS plvis the sums of products for characteristics weighted 4 or 
more which were not specified or selected in Phases 1 and 2. They indicate 
what the desirability of each occupation would have been if all important 
characteristics had been specified* 

The most obvious measure of a student's ability to discriminate between 
occupations on the basis of their utility is to see whether he chose the oc- 
cupation with the highest DS at the end of Phase 1 and on his final rating 
as compared to both the cumulative^ and ideal DS's. A CDM who is competent 
in using the infonr*ation he has would select the highest DS In all cases. 

A second measure, RAT-DS , indicates the difference between ratings 
(i.e., marker positions) and rescaled desirability sums for each occupation. 
To rescale the DS, it is divided by the sum of all the weights that a stu- 
dent assigned to all characterist5xs: Phases 1 and 2 and "other character-* 
istics." In other words, the rescaled DS gets rid of variation attributable 
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to Individual differences in total weights assigned and is therefore com- 
parable across all students. The measure, RAT-DS is the sum of the differ- 
ences between ratings and rescaled DS's recorded for Phase 1, Phage 2, final 
cumulative, and final^ideal* A good user of information would show close 
agreement between ratings and desirability sums and therefore would have a 
relatively small value for RAT-DS . 

3ince this measure is a difference between two kinds of scales, the 
number per se has little meaning. A normative interpretation is provided 
by converting the number into a standard score. 

A third measure of how well a student uses the information he has, 
WT-CH , is the summad differences between the weight assigned to each char" 
acteristic and the amount of marker movement made for that characteristic. 
A good user of information should be more responsive to the impact of in- 
formation about characteristics he has deemed important than about charac- 
teristics he considers less important. Therefore, he should show high agree 
ment between weight (importance to the student) and change (marker movement) 
for each characteristic, with higher weights producins; larger changes. 
Since tfT-CH is again a difference between two different types of scales 
and is not interpretable in absolute terms, a standard score is given. 

A fourth and final measure, AV CH 1/2 , is the ratio of the average 
change (marker movement per characteristic) in Phase 1 to the average 
change in Phase 2. This cuts along the first and third categories (^'fcnows" 
and "uses"). The average change in Phase 1 should be greater than in Phase 
2 because the good CDH will generate his most important specifications in 
that phase ("knows") which in turn should inspire maximum movement Causes"). 

Means and Standard Deviations of SOC Measures 

Means and standard deviations of SOC measures are presented in Table 
IV-8. Also provided are the percentages of students sel:icting the occupa- 
tion with the highest desirability at various stages; (1) at the end of 
Phase i; (2) at the end of the game, with desirability sums based on char" 
acteristics from Phases 1 and 2; and (3) at the end of the game using ideal 
desirability sums. Finally, in (4), is the percentage oE students selecting 
the highest desirability occupation in all three cases cited above. 

The major highlights from the table are summarized below, 

- At least seven of the eight SOC scores registered sizeable 
individual differences with standard deviations running 
high. The exception is AV CH 1/2 . A limitation on the use 
of the scale ^3 points) accounts for the apparently lower 
variance of this measure* 

On the average, students assigned only slightly higher 
weights to specif icatic^s^in Phase 1 than to those in 
Phase 2 ( W 1/2 = 1.1) jnd considerable higher weights to 
specifications in Phase 2 than to those presented at the 
final stage of the game (W 2/3 = 2.4). 
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- Setting a time limit of 10 minutes in which students 
could generate specifications seems to have had little 
effect on the number of characteristics elicited. In 
the past, without time restrictions imposed, the aver- 
age number of student specifications was approximately 
five. 

- Most students selected the occupation with the highest 
desirability s\im* 



TABLE 

MEANS AND STANDARD DEVIATIONS 
<N=30t J9th & 12th 



IV-8 

OF SOC MEASURES, SPRING 1975 
Graders Combined) 





X 


S.D. 


TOP VAL 


2.0 


.7 


W 1/2 


1*1. 


.3 


N SPECS 


4.3 


1*1 


N PROBES 


2.0 


1.7 


W 2/3 


2.4 


1.9 


AV CH 1/2 


1.0 


.2 


RAT-DS 


54.5 


20.7 


wr-CH 


2.0 


.6 



Percent Choosing Occupation with Highest DS at: % 

<1) END PHASE 1 77 

<2) FINAL/CUM DS 90 

<3) FINAL /ideal DS 82 

<4) 1, 2 & 3 above 62 




ERIC 



^98- 



Intercorrelations Among SQC Measures 

Intercorrelations among the SOC measures are presented in Table IV'*9r, 
It should be noted that some of the correlations may be artifacts of over- 
lapping information. The clearest illustration is the correlation between 
TOP VAL and W l/2 (r = .65). Both scores are a function of the extent to 
which specifications in Phase 1 represent characteristics that are weighted 
high in importance • 

Aside from such built-ii; relationships, the tnagnitude of the inter- 
correlation coefficients indicates that* in general, the measures are rela- 
tively independent of one another. The negative relationships noted be- 
tween N PROBES and the first three measures are of course consistent with 
expectation. 

Students who specify characteristics representing their top-weighted 
values and who generat* more specif icat-lons tend to require fewer probes. 
This fjading> notwithstanding the premise that a greater number of speci- 
fications provides a larger base or opportunity for prohes, suggests that 
students who name their most Important occupational values tend to express 
them most clearly and unambiguously. (PresumablV, there would have been 
even higher negative coefficients if N PROBES had been defined as a ratio 
of the number of prohes to N SPECS .) 

Knowledge of the most important values does not > however, in this 
sample appear to be related to fluency. Even though TOP VAIi is related to 
N PROBES and N PROBES to N SPECS , neither ToP VAL nor W l/2 is related to 
N SPECS . Perhaps the most fluent students are able to generate more speci- 
fications because they dip into characteristics of lower importance. Or 
Derhaps thev are more likely to give every characteristic of concern to 
them a higher weight. 

This latter hypothesis may be borne out by the relatively high cor- 
relation between H SPECS and W 2/3 . This coefficient C.46) is the highest 
in the matrix* Thus, we see what may be an interesting tendency for those 
who generate more specifications to assign relatively high weights to the 
three additional characteristics that they select from a residual list of 
characteristics. They must give low weights to only those characteristics 
they neither specified themselves nor selected. 

The negative correlation between W 1/2 and RAT-DS (-.24) suggests that 
students who specify characteristics of greater importance than the three 
characteristics they select from the remaining list tend also to rate the 
occupations in a manner consistent with the Desirability Sums of the occu- 
pations. ( RAT-DS is > of course, a measure on which lower scores are better.) 

The relationship between AV CH l/2 and TOP VAL (.26) and W 1/2 C.39) 
indicates ";;hat students tend to use the attractiveness scale in a manner 
consistent with how important they feel the characteristic is to them* 
These correlations, along with the correlation between AV CH 1/2 and N SPECS 
(.26), suggest that there may be a connection between knowing values and 
logical use of information relevant to those values. 
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TABLE IV-9 

INTERCORRELATIONS AMONG SOC MEASURES, SPRING 1975 
(N=30: 9th & 12th traders Combined) 





TOP VAL 


W 1/2 


N SPECS 


N PROBES 


W 2/3 


AV CH 1/2 


RAT-D 


TOP VAL 


1,00 














W 1/2 


.65 


1,00 












N SPECS 


,07 


-,11 


1.00 










N PROBES 


-.27 


-.16 


-.26 


1.00 








W 2/3 


-,22 


-,10 


.46 


.03 


1,00 






AV CH 1/2 


.26 


,39 


.26 


-.06 


,07 


1,00 




RAT-DS 


-.06 


-,24 


00 


-.06 


-,11 


-.11 


1,00 


WT-CH 


.05 


.07 


^,13 


-.08 


-.15 


.05 


-,17 



The four dichotomized measures — whether at various stages the student chose 
the occupation with the highest DS — are omitted from this Table of Inter- 
correlations , 
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Profile of a Hypothetical Good CDM 

Before looking at the performance of representative students in the 
Spring 1975 study, it may be enlightening to provide a standard of compe- 
tencies in the form of a hypothetical Student X, whose responses were con- 
structed to represent ''good" career decision -making behavior. Exhibits tV-7 
and IV-8 record the moves, weights, and ratings for Student X. In addition. 
Table IV-10 shows X's scores compared with group means for the Spring 1975 
study. 

In virtually all cases. Student X did quite well in both criterion- 
and group-referenced terms. 

Looking at measures of how well the student knows what he needs in an 
occupation and can get the information he wants, we see that Student X 
specified all three of his top-weighted characteristics in Phase 1. The 
average weight for Phase 1 characteristics, 7, exceeded the average weight 
for Phase 2, which was A ( W 1/2 - 1.8). On the whole. Student X's specifi- 
cations in Phase 1 were more important to him than the characteristics he 
selected in Phase 2. X had 5 specifications, one above the group mean, 
and no probes. In other words, he demonstrated both fluency and clarity 
in making specifications. So far, his scores are clearly "good" in both 
criterion-referenced and groups-referenced comparisons. 

But W 2/3 > a comparison of the weights assigned to Phase 2 character- 
istics relative to other characteristics, tells another story. l-Jhile X 
did well, his score was below the group mean. Looking at why this i$ so, 
we find that students in the spring sample tended to assign higher weights 
to Phase 2 characteristics than X did. Indeed, the average of their Phase 
2 weights equaled the average of their Phase 1 weights ( W 1/2 = 1). But 
X was able to specify all his most important values and so gave lower 
weights to the three characteristics he selected in Phase 2 ( W 1/2 - 1.8). 
Thus, although the weights X assigned to "other characteristics" were low, 
the ratio W 2/3 was not as great as the mean observed in the field test. 
This points out a deficiency in the measure that we had not anticipated 
and suggests that it should not be used normatively. Instead, it may be 
regarded as categorizing students in reference to a standard: W2> W3 is 
a "good" sign, whereas W2 < W3 is a "bad" sign. 
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TABLE IV-aO 

SOC SCORES FOR HYPOa:HETICAL GOOD CDM, SPRING 1975 







o * U* 


Va.. <?rn-r« "Y" 

fvSW ocote A 




TOP VAL 


2.0 


.7 


3.0 




W 1/2 


a.i 


.3 


1.8 




N SPECS 


4.3 


1.1 


5.0 




N PROBES 


2.0 


1.7 


0 




W 2/3 


2.4 


1.9 


2.0 




RAT-DS 


54.5 


20.7 




+1.9 


wr-CH 


2.0 


.6 




+1.6 


AV CH 1/2 


1.0 


.2 


1.9 





CORJIECT CHOICE % 

<1) End Phase 1 77 Y 

<2) Final/Cum DS 90 Y 

<3) Final/Ideal DS 82 Y 

<4) 1, 2» & 3 above 62 Y 
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How well did Student X use the information he had? The AV CH l/2 score 
was 1 .9 , Indicating that X made marker movements in Phase 1 almost twice those 
in Phase 2, Thus, we see X^s ability to react in proportion to the importance 
of information received. Furthermore, he chose the occupation with the high- 
est DS at the end of Phase 1 and on his final rating as compared with both 
cumulative and ideal T>S's. Only 62% of the students in the sample chose cor- 
rectly in all three cases* Beyond that, X's ratings show unusually good cor- 
respondence with DS's — much better, in fact, than most students in the Spring 
1975 group. (Since X' s RAT-DS raw score bad no intrinsic meaning, it was con- 
verted to the standard score, +1.9*) Such close correspondence between X's 
ratings and Desirability Sums shows the student's ability to judge the at- 
tractiveness of the three occupations in a manner that reflects their desir- 
abilities . 

The WT-CH standard score for Student X was +1.6* In other words, stu- 
dent X was 1*6 standard deviations above the mean of the group in the extent 
of agreement between the weight he assigned each characteristic and his total 
marker movement for that characteristic • Consistency in the use of the scales, 
making bigger moves in response to information about more important charac- 
teristics, while not obvioui^ly diagnostic of competency in career decision- 
making, probably reflects a capacity to integrate subjective values and ob- 
jective information* 

To the standard of performance represented by X's scores, let us now 
compare the scores obtained by three representive students in the Spring 1975 
administration of SOC. 

Profiles of Three Students in the Spring 1975 Field Test 

To show how the SOC measures can be used to diagnose a student's strengths 
and weaknesses in career decision-making, the recording forms and worksheets for 
three students are provided, <See Exhibits IV-13 through IV-15i) Profiles 
derived from these records are presented in Table IV-lli A discussion of 
these profiles follows. 

Student tfl [Exhibits IV-l3(a) & (b)], Overall, Student #1 was a very 
good decision-maker. He specified all three of his top-weighted character- 
istics in Phase 1 (TO? VAL = 3) and his specifications were more important 
to him than the characteristics he selected in Phase 2 (W l/2 = 1*2). He had 
a high number of specifications, 5, and no probesi Like the hypothetical good 
CDM, he knew what he wanted in an occupation and was able to make clear speci- 
fications I 

Student ifl also did well on the measure, W 2/3 * The characteristics not 
selected in Phasje 2 were much less important than the ones selec ted"their 
average weight was 2 as compared to 6 for Phase 2. This student knew how to 
select the information he needed. His AV CH 1/2 score of 1,3 shows that he 
used information logically,' making larger moves in responses to the informa- 
tion he received in Phase 1 (for the specifications that were more important) 
than for the information he received in Phase 2i 

Like the hypothetical good CDM (and 62% of the sample). Student //I chose 
the occupation with the highest DS in all cases, showing an ability to use 
the information he hadi 
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The RAT-DS and WT-CH measures are standard scores comparing each stu- 
dent with the reference group In ability to use the scales properly. The 
diagnostic value of these measures Is not Immediately clear and awaits fur- 
ther evaluation which will relate them to other known quantities. 

Student #1 did slightly worse on these measures than the group as a 
whole. Hig RAT-DS score was .4 SD below the mean, showing that correspondence 
between ratings and DS's was relatively low. Likewise, close agreement was 
lacking between weights and change (.4 SD below the mean). If these scores 
are Indicators of how well a student applies Inforioatlon, they run contrary 
to the criteria of correct choices. However-, the correct choice measures 
are Independent of scale usageand, as dichotomies, represent a gross measure 
of how well a student can use Information. RAT-DS Is an attempt to provide 
a measure permitting finer discriminations of students' relative ability to 
translate the attractiveness of occupations Into scale positions. Similarly, 
WT-CH Indicates the student's consistency In assessing importance of Informa- 
tion and showing Its Impact on him. Since almost 2/3 of the students selected 
occupations ^Ith the highest desirability, these finer measures — pending fur-- 
ther analysis and evaluation — might be n€!^ded to get further discrimimition. 

Thys, Student //I appeared to show considerable competence in most career 
decision-making behaviors evoked by SOC: he knew his own values, initiated 
multiple specifications on Important characteristics, and expressed them 
clearly; he sought and selected the most important residual characteristics; 
and he applied information to decision-making in a logical and rational way, 
dfstitiguishing what may be regarded as correct choices. On the other hand, 
notwithstanding his ability to come up with the '*right answers'* in comparing 
one occupation with another, there appeared to be some weaknesses in manipu- 
lating information about one occupation at a time. 

Student ifZ [Exhibits IV-14(a) & (b)] . Student ifZ was not quite so good 
as Student #1 in getting the information he wanted and in making clear speci- 
Ifications. Only two of his top'^three values were specified in Phase 1> al- 
thoughhfe specified characteristics of higher average importance in Phase 1 
than those he selected in Phase 2 ( W 1/2 =1.3). He made one less specification 
ihan ^tudent H and had one probe, indicating that he needed help from the in- 
terviewer in formulating specifications. 

Student 92 did not do so well as the group in getting the information he 
needed. Phase 2 characteristics had an average weight of 5.7 and other char- 
acteristics an average weight of 4,2 ( W 2/3 = 1.2). One characteristic which 
was not selected in Phase 2 received a higher weight than two of the char- 
acteristics which were selected. We can conclude that Student ^2 did not 
measure up to Student #1 in knowinp, and getting the information he needed. 

While AV- CH 1/2 shows that the impact of Phase 1 information items was 
greater thah^'Phase 2 items, this student was not able to use the information 
he had in selecting the occupation with the highest DS at the end of Phase 1, 
nor was he able to make the choices that agreed with the Ideal DS. This is 
an unusual case, since most of the students in the sample were able to do so. 

The somewhat poor showing on WT-CH suggests further problems in using 
i|i[formation. 
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Student #3 [Exhibits IV*15(a) & (b)3 . Student #3 was not able to get 
the information be wanted. He specified only one of his three top-weighted 
values in Phase 1. W 1/2 was less than 1 showing that, in general, he did 
not specify the most important characteristics in Phase 1. He made four 
specifications which required eight probes, an unusually high number. Stu- 
dent ^^3 was not able to formulate his specifications clearly. 

As for selecting the information he needed. Student //3*s average weight 
for Phase 2 characteristics was 7.7 and for other characteristics was 4, 
making the W 2/3 ratio equal to 1.9, which is below the group mean of 2.4. 
The high average weight for "other characteristics," 4, is a further indica- 
tion that this student was not able to differentiate clearly what informa- 
tion he wanted from the pool of information available. The AV CH 1/2 score 
of less than 1 shows that the student's responses to Items of information in 
Phases 1 and 2 was consistent with the weights he assigned to characteristics 
in Phases 1 and 2, respectively — that is, Phase 2 weights were higher than 
Phase 1 weights, and Phase 2 moves were greater than Phase 1 moves. 

This student was able to use the information he had to seli^tzt the occu- 
pation with the highest DS in all three cases. But the last two scores, 
based on the use of the scales, show a consistently poor performance. 

Overall Student ^^3 appears to have had some difficulty in each of the 
major areas of career decision-making. 
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TABLE IV-11 

SOC SCORES FOR STltDENTS IN THE SPRING 1975 FIELD TEST 

Students 



ERIC 



SOC Measures iX H H 

TOP VAL 3 2 1 

W 1/2 1.2 1,3 .4 

N SPECS 5 4 4 

N PROBES 0 18 

W 2/3 3.0 1.2 1.9 

AV CH 1/2 1.3 1.3 .9 

RAT-DS -.4 0.0 -1.8 

WT-CH -.4 -.5 - .2 



CORRECT CHOICE 

End Phase 1 Y.N Y 

Final/Cum DS Y Y Y 

Final/Ideal DS Y N Y 
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C^omments on Scores 

The scores developed for the Spring 1975 administration have consider- 
able suinmarv power: thev describe individuals in a way that enables us to 
recapitulate and characterize their behavior in the simulation exercise. Ob- 
viously, however, as in any summary, a great deal of information is lost. As 
we examine these scores in the light of detailed descriptions of students' 
behavior on SOG, we feel that thev have the virtue of depicting intra- 
indivXdual variations quite well. Thus, we might say that a given student 
knev^ what he wanted, specified fluently and clearly what he valued, 
and yet had difficulty handling information in a logical and consistent way. 
Another student might be said to have difficulty in specifying what he wanted, 
yet recognized important characteristics when they were presented to him and 
han^^led information about them quite adequately. 

Yet in making these statements about students, we are depending on a 
melange of scoring operations and interpretations. Some scores are criterion-- 
referenced, others group-referenced. Some involve continuous scales, while 
others are dichotomized. Some are entirely independent, while other^are 
linked. Some are computed in a simple way — for example, tallies — but others 
involve a lot of arithmetic. Some interface clearly and openly with con- 
structs, while others can be given meaning only through lengthy chains of 
inference. 

As we study these scores, we find ourselves Particularly dissatisfied 
with those that depend on referance groups rather than on criterion stan- 
dards. After all, we do not have a good norms grouP for this tryout, nor 
is there likely ever to be a single norms group that will be universally use- 
ful for this kind of measure. Furthermore, the problems adumbrated above 
interact in complex ways when attempts are made to coTiipare students on the 
basis of their SOG scores. Because the game is tailored to the individual 
student, the information upon which students base their decisions about the 
most desirable occupation is variable. One student may have more conflict- 
ing information than another, depending upon what characteristics he speci- 
fies or chooses. A student who names many specifications usually faces a 
more difficult decision than the student who has few specifications. In 
some cases, the student is penalized for his fluency. Thus, a student's per- 
formance in one category of competence may often depend on variable condi- 
tions generated by his performance in another. 

Also, depending upon how a student assigns weights and the degree to 
which the information conflicts, one student mav have to choose between oc— 
cupations whose DS's are nearly equal whereas for another student they may 
be widely divergent. In other words, some students have "easier" choices 
to make than others. Of course, both these phenomena apply as well to real- 
life choices as to simulated occupational choice. 

Another confusing factor is the student's interpretation of "possible" 
In response to a specification. Students interpreted this response in many 
ways; as slightly favorable, very favorable, neutral^ slightly unfavorable, 
and very unfavorable. However, the instrumentality of this information was 
always 2, A student could therefore be Internally consistent and logical 
In his interpretation of ''possible," but could interpret it differently 
from other students. 
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Therefore, when Information was seen In combination, an occupation with 
many "possible's" might seem more attractive to some students than to others. 
After all, one purpose of the simulation exercise Is to allow students to 

work within their own frames of reference, to supply their own values and 
their own nieanlngs. So It Is to be noted that In the next administration 
of SOC, scores were considerably revised, along with a few changes In ad- 
ministration procedures* 

tf 

Despite such revisions, the findings described previously and the con- 
siderations addressed In the comments above confirm our growing conviction 
that SOC scores are more appropriately applied to Intra-lndlvldual analyses 
than to comparisons between Individuals or groups. They provide a window through 
which we can observe the i^ay each student handles the career decision-making 
tasks that he encounters In SOC. But the relationship between the student 
and SOC Is Interactive: even as the student responds to the tasks presented 
by SOC, so Is SOC responsive (In varying degrees) to the student's behavior. 
Thus, the nature of some of the later tasks Is Influenced by what the s ar- 
dent does earlier In the simulation. Inter-lndlvldual or Inter-group com- 
parisons on some of the scores may be muddled, then, by these Interactions. 
A given score Is much more meaningful when viewed In the context of other 
scores obtained by the same student than when pulled out of that context 
and compared in Isolation with the corresponding score obtained by another 
student. 

It Is, after all, a major advantage of an Individually administered 
test that It can be responsive to Individual differences In behavior. Other- 
wise, one could more efficiently use a group-admlnlstered Instrument. 
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EXHIBIT IV-1 

PRESENTATIONS GIVEN TO EXPERIMENTAL CONTROL GROUPS PRIOR TO ADMINISTRATION OF SOC 



Control Group 

We are from Educational Testing Service. In the next few weeks we will be 
seeing some of you Individually to play a game that will measure how good you are 
at making decisions about careers* This game Is part of a research project at ETS* 
The results will be strictly confidential and will not be part of vour school 
record • 

This Is a chance for you to participate In a research project, it will only 
take one class period to do. Students who have already played the game have said 
that they learned new things about themselves. They also felt better prepared to 
think about occupations. 

[For seniors — We know that your're concerned 
with graduation, but we would especially ap- 
preciate your participation* Remember, it's 
only one class period*] 

Before you can participate^ we need permission from your parents. Here is 
a letter for your parents* Be sure to show the letter to them tonight^ hava them 
fill in and sign the reply form, and return the form to this class tomorrow (or 
the next day). Once we have your signed permission slip, we will call you at home 
and arrange a time for you to play the game during a free period or a class period* 



[For seniors — If you are over 18^ you may 
sign the permission form yourself • ] 

Any questions? 
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EXHIBIT IV-1 (contj 



Experimental Group 

We are from Educational Testing Service. In the next few weeks we will be 
seeing some of you individually to play a game that will test how good you are at 
making decisions about careers* We would like the students in this class to do 
particularly well, so we will take some time today to help you prepare* 

We plan to see several classes while we're here. Not all of them will get 
special help. Please do not discuss what we do today with any other students un- 
til the project is over, which should be in a few weeks. This game is part of a 
research project at ETS, The results will be strictly confidential and will not 
be part of your school record* 

I'm not going to tell you a lot about the gai:;** now because you will be given 
detailed directions when you play it. However, when you play the game, I will 
ask you, "What is important to you in choosing an occupation?'* Johnny might say, 
**high income" while Mary might sav, ''I want to do scientific research.'' Differ- 
ent people want different things* 

Let's see what sort of things we can come up with as a group* Let's make a 
list. We already have two things on the list — high income and work in a parti- 
cular field. What things are important to you in choosing an occupation? 

(List 5 specifications, with amount where 
needed, on the board. Point out job- 
specific specifications.] 

Here are some things we haven't covered which other students have found im- 
portant* (List other values, abilities, and working conditions.] 

It's not enough to know what you want; you must also decide how much you 
want it. Since it's unlikely that you will get everything you want in an occu- 
pation, you have to decide which things are necessary to have and which things 
you could live without* 

[Point to student*] Look at this list* Which of these things is most im- 
portant and least important for you to have? [Call on ^5 students*] 

As you can see, people have different ideas about what they want and how 
important these things are to them. 

In preparing for this game, we want you to make up your own list of what 
you want iji an occupation—not what someone else wants* You should also decide 
how important each thing is to you* If you know these things, you should do 
well in this game. 

When you play the game, you may only have time to specify 5 or 6 things* So 
be sure that you have thought about them enough so that you can specify things 
that are most important to you* If you are unprepared, this will lower your 
score. 
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EXHIBIT IV-1 (cont.) 



I will now pass out letters for you to take to your parents* We need their 
permission for you to play the game. Be sure to show the letter to your parents 
tonight » have them fill in and sign the reply form> and return the form to this 
class tomorrow (or the next day). Once we have your signed permission sllp» we 
will call you at home and arrange a time for you to play the game. It will take 
one class period and we will schedule you sometime during the next 2*^3 weeks 
during your free period* (Fill in your name» grade» house» and home telephone 
right now.) 

This is a chance for you to participate in a research project. Students who 
have already played the game have said that they learned new things about them* 
selves* They also felt better prepared to think about occupations. 

Any questions? 
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EXHIBIT IV-2 
LETTER TO PARENTS WITH PT^RMISSION SLIP 



I'lDl A I [ON A I. n^h^STl N(; SKRVICE I'HlNCfcjjON, N,J. 08540 



921 .9000 



Drvetoptneittat Rntnrch Division ^-^Xj 1975 



Dear Parent: 

The Guidance Research Group at Educational Testing Service is developing a 
measure of competence in career decision-making for high school students* its 
purpose Is to evaluate, diagnose^ and help Improve decision-making skills. This 
project is funded by a grant from the National Institute of Education. 

This is an opportunity for your child to learn something about himself and 
his future career choice. At the same time, your child will be ^assisting us in 
developing a procedure to measure competence in cfireer decision-making. All in- 
formation will be kept strictly confidential and used for research purposes only. 

Your child's class has been selected for this research* Parental permission 
Is necessary for your child to participate. 

One class period is required of each student, but this will not interfere 
with his f>tudies. We will contact your son or daughter by telephone to arrange 
a convenient meeting time. 

We have the cooperation of Hightstovm High School. We hope you will agree 
to your child's participation In this study. Please complete the form below 
and have your child return it to school tomorrow* 

If you have any questions, please feel free to call me at 921-9000, ext. 
2316 or contact Miss Linda Kay Thompson, Guidance Content Specialist, Hightstown 
High School • 

Thank you for your cooperation. 

Sincerely, 
Lila Norrls 

LN:inb Co-Project Director 



Student's Name Grade House 

(Please print) to1o«i.««o 

Home Telephone 



I ] I give ^ permission for ray son/daughter tc participate in the 



[ ] I do not givej 



Career Decision-'Making Project. 



1^3 

Parent's Signature 
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EXHIBIT IV-3 
ATTRACTIVENESS SCALE 



X Y 



A 



4 /A 



+ *? — 



+ 3 -<X 



-3 



- 4 



-1 " 



+/i -- 



3 



marker 

o 



-3 



track on 
which marker 
slides 



-/A 



4U 



-f^ -- 



3 "O! 



- 3 



-- 



ERIC 



124 



^113- 

EXHIBIT IV-4 
DESCRimi?T; CARDS 

REWARDS & SATISFACTIONS 

The following definitions were typed on 3 x 5 cards. The name of the 
characteristic also appeared on the reverse side of the card* 

Security concerns the degree to which your occupation and income are 
protected from hard times or nei^ labor-saving Inventions. With high security 
you would be reasonably sure of keeping your job and income. With low secur- 
ity you might easily lose your job and income. 

Independence is the extent to which you make your own decisions and work 
with or without supervision or direction from others- If your occupation of- 
fers high independencttj you would he your own boss. Low independence would 
mean working under close supervision^ carrying out the decisions of others. 

L eader ship/Responsibilitjr is the extent to which you guide others, tell 
them what to dOj and are responsible for their performance. If your occupation 
offers high leadership/responsibility, you would direct activities and in- 
fluence people. You would also accept responsibility for the performance of 
the people you direct. With low leadership/responsibility you would not direct 
other people and you would not be responsible for their performance. 

Income is the amount of money you earn in an occupation. If your occupa- 
tion offers high income, you would earn much more than you would in most other 
occupations. Low income means you would earn far less than you would in most 
other occupations* but you would still be able to support yourself. 

Helpinfi Others Directly is the extent to which you help people face-to- 
face as part of your occupation. If your occupation offers a great opportunity 
to help others, you would spend most of your time working with people to im- 
prove their health, education* or welfare as teachers and doctors do. If your 
occupation does not offer an opportunity to help others, you may do work — such 
as newspaper reporting — that is useful to society* but that does not assist 
other people face-to- face. 
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EXHIBIT (contO 

Work In Your Main Field of Intereat 

An Interest field Is a particular area of occupational activity* There 
are many different Interest fields Including scientific^ verbal* administra- 
tive and buslnessi, personal contact, artistic, and technological* If working 
In your main field of Interest Is highly important to you, you would want 
your occupation to be in a particular field. If It is Important to you. It 
would make little difference which field your occupation was In* 

Leisure has to do with the amount of time your occupation will allow you 
to spend away from work* In an occupation which has lots of leisure you will 
have short hours, long vacations, and the chance to choose your own working 
hours. With low leisure you will often work long hours, Including nights and 
weekends, with short vacations and no choice of hours* 

Prestige Is the degree to which an occupation commands respect In people*s 
minds* An occupation with high prestige Is one which most people look up to* 
An occupation with low prestige Is one which does not command general respect* 

Variety concerns the extent to which your work activities are many-sided* 
If your occupation offers a large amount of variety, you would find yourself 
frequently doing different kinds of things. Interacting with many different 
people, and working In many different places* Low variety would mean doing 
mostly routine and repetitious work with the same co-workers and In the same 
place every day* 

Required Occupational Education is the amount of education or training you 
must take beyond what you already have In order to meet entry requirements for 
an occupation. It Is only education that Is required to enter an occupation, 
not what you take for any other reason « 

[Note: Although this comes under rewards and satis^ 
factions. It Is only used If specified by the student 
in Phase 1. This Is because education Is often seen 
as a means to other values and not as an occupational 
value* Its presence therefore tends to be confusing*] 
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EXHIBIT IV-4 (cont.) 

ABILITIES 

Requirement; Skill in Worklns with Intellectual Concepts 

Skill in working with intellectual concepts means that a high level of 
intellectual work is required™using your brain rather than physical strength* 
Math Or verbal skills must be high. 

Requirement; Skill in Working with People 

Skill in working with people means that you must be good at persuading, 
supervising, instructing and/or counseling other people. It may also involve 
work with plants or animals. 

Requirement; Skill in Working with Things (tools, instruments, machines) 

Skill in working with things means that you must be skillful with your 
hands or good at work with instruments, tools, and machines. It may also re- 
quire physical strength or agility. Construction or creation of new physical^, 
objects may be involved. ^ 

WORKING CONDITIONS 

Travel Requirements 

This involves the extent to which travel Is a requirement of the occupa- 
tion. 

Type of Work Setting 

This involves the chances of working In a particular setting such as in- 
doors or outdoors • 
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EXHIBIT IV-5 

TYPICAL ARKAY OF INFORMATION IN KESPONSE TO STIIDENT*S SPECIFICATIONS 
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IMPORTANCE SCfiLE" 



} I 




descriptive card 
inserted in pocket 



? 



NO 

IMPORTANCE 



MODERATE 
IMPORTANCE 



GREATEST 
IMPORTANCE 



/7 



-118- 

EXHIBIT IV-7 
DESIRABILITY SUM WORKSHEET 
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EXHIBIT 1^-8 

SOC RECORDING FORM 

Student's Naste Grade /School Interviewer's Name Date 
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EXHIBIT IV-9 

DISPLAY LABEL AND INFORMATION STRIPS 





Spec 


y 


Y 

1 


7 
/ — 




Income. 


L.Ve\«, 








above 






L^'^ sore 














average 



display 
label 



space for 
writing In 
amount or 
level desired 



Information 
strips 



("Very Likely" Is colored green; 'Very Unlikely'' 
Is colored red,) 



132 



-121- 
EXHIBIT IV-10 
INFORMATION STRIP CLUSTERS 



Characteristic 


X 


y 


Z 


INTEREST FIELD: 
Sci^ Verbal^ Admin 


3 




2 


Ability - Concepts 


3 




2 




3 




2 


Leade rship/Responsibility 


3 




2 


In come 


3 




2 


INTEREST FIELD: 
Personal Contact 


1 


2 


3 


Independence 


1 


2 


3 


Variety 


1 


2 


3 


Helping Others 


1 


2 


3 


INTEREST FIELD: 
Technological, Artistic 


2 


3 




Ability - Things 


2 


3 




Security 


2 


3 




Leisure 


2 


3 




Required Occupational 
Education 


2 


3 




Working Conditions 

Physical Surroundings 
Travel 


2 


3 





133 



-122- 



EXHIBIT IV-11 
SOC SCRIPT, SPRING 1975 

This is a game designed to test how good you are in making career decisions. It 
may also help you learn how to make better career decisions. 

In this game, you are going to choose one out of three occupations that's best for 
you, and decide which one would be worst for you. 

As yo^ know, occupations change. Many occupations that people are working in today 
did not exist a generation ago — for exaiople, ecologist and physician's assistant. 
In the future, people will be working in occupations that do not exist today. 

Now suppose I have advance information on three occupations of the future. Let's 
call them X, Y, and Z. You have to select one of the three to prepare for. So 
you want to find out how attractive or unattractive each of these three is to you. 
To do this, you have to tell me what you want in an occupation. Then I can give 
you in:?ormation about the three occupations. 

In other words, you can specify the things that are most important to you in choos" 
ing the best and avoiding the worst occupation. Let's call these things specifica- 
tions. Each time you give me a specification, I will tell you the likelihood of 
satisfying it in each of the three occupations. I will record your specifications 
and the information here. 

[Indicate Display Label.] 

Suppose we were talking about cars, rather than occupations. What are your speci- 
fications for choosing the best car for yourself? What is most important to you 
in choosing a car? 

[Give example of specifications if necessary. 
After student makes specifications, show him 
a sample answer strip. Draw parallel to oc- 
cupational specifications.] 

Before we begin the game, I'm going to give you a few minutes to think about your 
occupational specifications. Jot down the things that are most important to you 
in choosing an occupation—not a particular job in the occupation^ but the occu- 
pation as a whole. For example a secretary could work for a bank or for the Presi*- 
dent of the United States. These are particular jobs within the occupation, secre- 
tary. In this game, we are conceimed with occupations. 

Do you have any questions? 

[Provide paper and pencil. Give student 3 
minutes . ] 

You will have 10 minutes to tell me your specifications and to get information. So 
be sure to specify those things that are most important to you in order to make the 
best use of your time. Use your list as a guide. Pick the things that are most 
important and ask about those first. You are not limited to the list. 
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EXHIBrr IV-11 <cont.) 



PAKT I — Choosing 



an Occupation 



Phase 1 



O.K.> what Is your 



first specification? 



[Student gives specification* Place strip 
containing specification and Infonoatlon 
under display label. Explain answer strips. 
"Unlikely" always means less than desired. 
If wording of specification differs from 
prepared strlpj^^use Identical extra strip. 
If probes are required, record them with 
check mark In extra spaces on recording 
form. ] 



Here Is a scale on which you*re going to show me how attractive you find each 
occupation. Each occupation has Its own scale and marker. 

The three markers are now at zero, Indicating that you feel Indifferent about the 
three occupations. If an occupation seems better on the basis of the Information 
you just received, move Its marker up. If It seems worse , move down . If the In- 
formation makes no difference, leave the marker where It Is . 

You may not move the markers more than three points up or down the scale In any 
one move . If the Information makes you feel a gr^at deal better or worse about 
an occupation, you should make a big move. If not, make a small move or no move. 

Do you understand? O.K., use the markers. 



I*m going to place Lhls new Information on top of the old . I want you to con- 
sider this Information by Itsel f. At the end you will see all the Information 
at once . 

How much better or worse do the three occupations seem on the basis of this new 
Information? 



Now look over all the Information you have about each occupation. You may use 
the whole scale to show how attractive or unattractive each one Is to you. You 
may leave the marlcers where thiy are or move any or all as you like; you are NOT 
limited to a three-'polnt move. 



[Record ratings. Periodically Interpret 
scale position to student. Make sure you 
both mean the same thing.] 



O.K. , what is your 



second specification? 



[Place second answer strip on top of first.] 



[Record ratings. Repeat process until time 
runs out or student exhausts questions. 
Spread out Information strips.] 



[Record final ratings for Phaee 1. Remove 
answer strips. Return markers to zero.] 
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EXHBIT IV-11 (cont.) 



Phase 2 

Now I am going to give you information that you didn't ask for. Select three of 
these characteristics that are most Important for you to know about. 

[Give the student cards for all the rewards 
and satisfactions (except education) not al- 
ready covered. Do not Include abilities or 
working conditions. Show the name only, not 
the defiTiltlon. After he has selected three 
values, have him read the definition and make 
a specification.] 

I want you to rate the occupations just as you have done before with a limit of 
three scale points per move. 

[Place each answer strip on top of preceding 
one. Kepeat scoring procedure for each 
characteristic. 

Then spread out all three information strips 
and have student move markers if he wants* 
using the whole scale.] 

Now look over th£9^^ three pieces of Information. You may use the whole scale to 
show how attractive or unattractive you find each occupation. You iBay move the 
markers now if you wish. 

[Record ratings. Return markers to zero. 
Spread out all answer strips.] 

Now you have all the information that I am going to give you about the three occu- 
pations. Consider it carefully. When you are ready, use the whole scale to show 
how attractive or unattractive you find each occupation. 

[Record ratings*] 

PART II — Evaluation of Student's Choice 
Phase 1 

You have chosen the occupation which you feel is most attractive to you. Now let's 
find out whether you made the best choice. 

Here are cards which define characteristics of occupations. They correspond to what 
you have seen. In addition^ there are cards which you haven't had Information about 
which many people consider to be Important. 

[NOTE; Include any rewards and satisfactions 
not previously specified. However^ do not 
include education card unless it was speci- 
fied in Phase 1. If more than one specifi- 
cation was made for a characteristic in 
Fha<je 1 (e.g., leisure, variety), write 
specification on blank card and delete typed 
card for sorting. Student sorts cards on 
Q basis of title; he does not read the defl^ 

ERIC nltlons.] 
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EXHIBIT IV-11 (cont.) 

How Important Is It for you to have each of these things in an occupation? 

I want you to sort the cards Into three plies according to how Important It Is. 
for you to have a satlafactory amount or level of each of these characteristics. 
One pile Is for the characteristics that are least Important to satisfy ^ one for 
characteristics that are more Important to satisfy ^ and one for characteristics 
that are most Important to satisfy . 

[Give student time to sort. Prepare de- 
sirability sum mrk sheet.] 

Now I would like you to arrange the cards on this scale. Note that 8 means of 
greatest Importance for you to satisfy and 0 means of no Importance for you to 
satisfy- Put the^t cards In the pockets which show the weights you want to assign 
to them . You may have more than one card In a pocket. Remember, the way you 
sort the cards will determine whether or not you chose the rl ^,ht occupation . 

[Give student the Importance scale. Student 
tnay have no more than 2 cards In the pocket 
labeled 8. Record weights on desirability 
sum worksheet. Finish worksheet preparation.] 

Phase 2 — Feedback 

1. Compute Desirability Sums (DS) for Phase 1> Phase 2^ and overall. 
Compare with scale positions. 

2. Count number of specifications and compare with those of other 
students . 

3. Compare weights In Phase 1 with Phase 2 weights and weights of 
remaining values. 

4. Get student reactions^ answer questions. 
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EXHIBIT IV-12 

* GUIDELINES FOR ADMINISTERING SOC 

Part I of Game 

Most specifications that students generate will relate to characteristics 
for which descriptive cards and Information strips have been made* (For a list 
of the cards and definitions of the characteristics^ see Exhibit IV-4). If the 
relationship Is not obvious^ use probes to help students clarify their speclfl* 
cations. For example, If a student specifies "Interesting work/' the Interviewer 
could ask what the student finds Interesting* This could lead to a specification 
about Interest field, variety, etc. 

Whenever students make specifications which require probes, record the speci- 
fications In the boxes at the right hand side of the Phase 1 section of the SOC 
Recording Form (see Exhibit IV-tJ). Next to each specification, place a check mark 
for each probe required before the student^s specification resembles a character- 
istic on the descriptive cards. Probes should be clarifying, but not leading. 

If a student^s specification relates to a characteristic for which there Is 
a card and an Information strip, use the prepared card and strip only If the word- 
ing Is close and makes sense to the student. Tot example. If a student's speci- 
fication Is ''work which Involves different activities at different locations," 
the card and strip for "Variety" would be appropriate. However, If a student 
specifies number of hours per week, the card and strip for "Leisure" would be In- 
appropriate, since "Leisure" Includes vacation and freedom to choose hours as 
well. In this case the Interviewer should use a blank Information strip which 
has the same Information as the one for leisure. Also a blank Index card with 
the specification about hours should be used rather than the prepared card, since 
the definition of leisure Is broader than the original specification. The card 
for leisure would not be presented to the student In Phase 2 and would not be 
sorted on the Importance scale In Part II. 

This bullt-ln flexibility means that a student's language Is used wherever 
appropriate rather than the prepared language of the game. The student assigns 
weights to specifications which are his, not someone else*s. Possible mis- 
classification and misunderstanding are thus avoided. 

Here are some examples of specifications commonly given by students for 
whldh Information cannot be given either because they are job-speclflc or because 
It Is not realistic to suppose we would know these things about occupations of 
the future. Appropriate Interviewer responses are suggested. 

Interviewer says, "I cannot distinguish between X, Y, and Z on this dimension 
because. . . " 

1. Benefit to Society: ...all three occupations meet your specification." 

2. Physical Activity: ...all three occupations Involve some physical 

activity and some Inactivity. The exact amount de- 
pends on the specific job within the occupation." 

3. Fringe Benefits: ...all three occupations offer^basic benefits. Ad- 

ditional benefits depend on the specific job." 
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EXHIBIT IV-12 <cont.) 

...all three occupations offer the opportunity 
to Interact with co-workers. The extent and nature 
of the Interaction depends on the specific job within 
the occupation.** 

...outlook Is the' same for all three occupations." 

.'.often advancement involves a change of occupation 
(e.g., secretary to administrative assistant). One 
of the three occupations of the future might have 
the characteristics of an occupation at the top of 
the advancement ladder. 

Probe: How would advancement help you? What 

are some of the things you would like to 
get from advancement? (Possible answers: 
Income^ prestige^ leadership.) 

NOTE: Tell the student that since Information doesn*t dlstlti^gulsh between 
the three occupations, you will not give him an Information strip. 
Be sure to record specification cm SOC Recording Form. 

Students also make specifications which are job-speclflc (e.g., getting 
along with co-workers or working close to home). Explain that the 
specification does not refer to the occupation as a whole and that no 
information can be given. Record the nature of the specification on 
the recording form. 

Some specifications are made In negative terms^such as not wanting pres- 
sure on the job. Use probes to help the student state the specification 
In positive terms or think of other specifications which are positive. 

As a general rule, do not alli>w subjective words like ^'Interestingy'* 
^'exciting," etc. In a specification. When such words are used, probe 
to find out exactly what Is meant. 

If a student*s specification includes more than one characteristic, tell 
the student that you can answer In two parts o£ he can choose the most 
In^ortant one to ask about. 

If the student specifies that he wants to do certain activities which 
he enjoys, give Interest field information. If the specification has 
to do with level of ability required, give ability Information (con- 
cepts, people, or things). 

If a student^B specification has to do with Interest field, classify 
It In one of three groups and use the appropriate Information strip with 
the student's general Interest written In. The three categories are: 

1. Scientific, Verbal, Administrative 

2. Personal Contact 

3. Technological, Artistic 



4. Co-workers: 

5. Outlook: 

6 . Advancement ; 
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EXHIBIT IV -12 (cont.) 



A student may specify more than one Interest field. This is fine* However, 
Instead of using the descriptive card for Interest Field In Part II, the In- 
terviewer must write the Interest fields on separate 3** x 5" cards for sorting. 

If a student specifies amount of education, show him the Required Occupation 
Education card. Have him make the specification In termr of the definition. 
The education card Is sorted on the Importance scale In Part II only if It 
was specified in Part I, Phase 1. It is never Included in the unsolicited 
information choice in Part I, Phase 2. This is because education is often 
seen as a means to other values and not as an occupational value. Its pres- 
ence, therefore, tends to be confusing. 



Part II of Game 

The student uses the Importance scale to sort cards representing his speci- 
fication, the three characteristics chosen In Part I-Phase 2^ and any extra cards 
representing rewards and satisfactions which were not previously selected. He 
does not sort the extra Ability and Working Conditions cards hecause their addi- 
tion would make the sorting process too cumbersome and confusing. 
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EXHIBIT IV-13(a) 
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EXHIBIT lV-13(b) 
DESIRABILITY SUM WORKSHEET 
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EXHIBIT IV- 14 (a) 
^ SOC RECORDING P6rM ■ 
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EXHIBIT lV-l4(b) 
DESIRABILITY SIJM WORKSHEET 
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EXHIBIT IV-15(a) 
SQC RECORDING FORM 
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EXHIBIT IV- 15(b) 
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CHAPTER V 
SOC ADMINISTRATION (FALL 1975) 



The Spring 1975 administration o£ SOC brought us much closer to a 
resolution of the problem of measuring competency In career decisions- 
making. However^ questions still remained concerning procedures and 
measures^ as described at the end of the last chapter. No further field 
tests were planned^ but since SOC was being used in conjunction with 
another project, it was once again revised and administered, this time 
to college rather tharphigh school students. 

Description of Sample 

SOC was administered to 27 freshmen at a 4-year college in conjunc- 
tion with another project designed to evaluate the computer'*based System 
o£ Interactive Guidance and Information (SIGI) which was in use at the 
school. Students were divided into experimental and control groups. The 
experimental group consisted of 15 students who had used SIGI as part of 
a course in career decision-making. The control group, 12 students, 
planned to take the course and use SIGI, but had not yet done so. Unfor- 
tunately, it was impossible, over the duration of the treatment^ to avoid 
contamination o£ the control group. They sometimes looked over shoulders 
of friends using SIGI and discussed the treatment with them. 



Revision of SOC Procedures and Materials 



The followinf^ changes were made after the Spring 1975 administration. 

The SOC procedure was divided into four phases rather than two parts 
with two phases each. This was done for ease of reference. 



The initial instructions to the student were shortened in order to 
highlight a few important concepts. Other directions were given in the 
course of playing the game. This saved administration time and made pro- 
cedures easier foi 3tudents to foliar. 



The 10-minute time limit for nicking specifications was abolished so 
that students could generate lists of all their important specifications. 
Students were told not to name unimportant characteristics of occupations. 

Students were no longer asked to specify the level or amount of the 
characteristic desired. Instead, the information ("very likely," "possible," 
or "very unlikely") referred to the level they had in mind. This eliml-^ 
nated an unnecessary step in making specifications and also saved time. 

Names of characteristics were not pre-printed on information strips. 
Specifications were recorded in the student's own words^ both on the in-^ 
formation strips and the descriptive cards. Prepared cards were used for 
Phase 1 specifications only when the student's words were the same as those 
on the cards. Thus, each card and information strip was readily meaning- 
ful to the student. 



After students made all of their specifications and rated the occupa- 
tions, they were asked to identify the descriptive cards which corresponded 
to their specifications. The interviewer no longer had to decide what stu- 
Q dents' specifications meant; the students themselves decided whether a pre- 

£J^(^" viously prepared card coincided with one of their specifications. J^47 
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The number of probes fM PRO BPS ) was no longer recorded in this admini- 
stration of SOC because it did not seem feasible to develop guidelines for 
making probes which would guarantee uniformity across interviewers. Also, 
probes were used less frequently because specifications were recorded in 
the student's own words rather than in a pre-arranged form. Therefore, as 
lon^ as the specification was meaningful for the student, it was not neces- 
sarv that the interviewer fully understand it. 

The descriptive card for early entry was no lonRer used* Students were 
free to specify level of education in Phase 1, but it was felt that the con- 
cept of early entry was too confusing to present to students in a later 
phase. 

Movement on the attractiveness scale was no longer restricted to moves 
of +3. Students could place discs anjrwhere on the scale throughout the 
game* Greater movement allowed for greater variety of response so that stu- 
dents could differentiate between information of varying importance* The 
scale was also shortened by 5 points, top and bottom, to run from +10 to -10* 

Two labels were added to the attractiveness scale to anchor the extremes* 
The top of the scale was labeled "the greatest'' and the bottom "the worst*" 
Thus, even though marker movement was unrestricted, the top and bottom of the 
scale were reserved for extreme reactions* 

In order to save time^ the desirability sum worksheet was no longer used 
in giving feedback to students about their performance* The other elements 
of the feedback session were retained* 

The SOC Recording Form was simplified and shortened in various ways* 
(See Exhibits V-1, 2, 3*) These changes made it easier for the interviewer 
to give feedback to students* (For the revised SOC Script, Fall 1975, see 
Exhibit 

SOC Measures 

The measures TOP VAL , W 1/2 , M SPECS , and AV CH 1/2 were computed as 
in the Spring 1975 administration* The number of probes (M PROBES) was dropped 
because of difficulties in attempting to standardize procedures for how and 
when to probe* The average weight assigned to Phase 2 specifications relative 
to '^eights assigned to characteristics not selected (W 2/3) was dropped and 
replaced by W 3 , i*e*, the average weight assigned to unchosen characteristics* 

In place of the ]W*CH measure to describe the correspondence between 
weights assigned to specifications and marker movement, a correlation was 
computed between the two* In computing the correlation^ the weights were jcst 
converted to standard scores* Marker movement for each specification was 
measured as the difference between the high and lo^^ rating* The correlation 
r^' was based on Phase 1 data; was based on Phase 1 plus Phase 2 data* The 
measure r_' was not computed if the number of specifications was less than 4. 

A new RAT -PS was computed* For the sake of simplicity^ desirability sums 
(OS's) were computed using all characteristics, even those weighted less than 
4, since use or omission of these items appeared to make no appreciable dif- 
ference* As before* desirability sums were rescaled by dividing them by the 
sum of the weights* They were then placed on a scale from 1 to 3 and forced 
into a fixed sum of 6* The end parts of the D5> scale were equated to those 
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of the attractiveness scale (-10 to +10) • Then expected positions on the 
attractiveness scale were computed on the basis of the rescaled desirability 
sums. The discrepancy between the actual and expected position on the at- 
tractiveness scale was calculated for each occupation and summed across the 
three to give the measures RAT-DS*a nd RAT-DS ". RAT-DS* refers to ratings 
at the end of Phase 1; RAT-DS " refers to ratinp;s at the end of the game. To 
check the relationship between ratings and rescaled DS*s, a correlation be- 
tween the two was computed across all students. At the end of Phase 1 the 
correlation was •74; at the end of the game the correlation was .69, 

Experimental and Control Group Differences 

Table V-1 gives the means and standard deviations of the SOC measures 
for the experimental and control groups (N = 15 and 12, respectively). Also 
provided are the percentages of students fselecting the occupation with the 
highest desirability at the end of Phase 1 and at the end of the game. 

While the difference between the means of the experimental and control 
groups was not significant at the five percent level on any of the SOC 
measures, it was encouraging to note that the differences did tend to favor 
the experimentals on TOP VAL , M SPECS , W 3 , RAT-DS \ RAT-DS" , and r^. The 
r ^ and r^ measures were squared and averaged to provide an overall index of 
determination; i.e,, the percent variance accounted for. While wide varia- 
tion across students was noted on all scales, as evinced by the magnitude 
of the standard deviations, no large group differences were found. 

That the differences between group means for these measures failed to 
reach statistical significance is attributable to the grossness of the meas*- 
ures, the small sample size, and contamination of the controls. Further, the 
structure of the game itself may have tended to diminish the variation of 
some of the measures. In revising SOC, we had tightened up the structure of the 
game, forcing all students to exhibit whatever good decision-^making behaviors 
they had while diminishing opportunities to display poor decision-making be- 
haviors. Students were told what to do — to consider dimensions that were im- 
portant and evaluate the relevance of these factors for three occupational 
alternatives. Further, to justify use of the W l/Z measure (in which a high 
score is achieved by omitting other than important considerations), students 
were advised to concentrate on important things first (during Phase 1)^ 
leaving the less important characteristics to be considered later in the game. 
I^ile these directions to the student were necessary to insure a good simu- 
lation, the end result was to have the structure of the game bring all stu- 
dents up to a level where they exhibited considerable competence in career 
decision-making. This was borne out by the ceiling effect on our measures 
(and a **floor effect'* on inverted scales such as W 3 ). as seen in Table V-1, 
Note that the group means for both experimentals and controls tended to be 
high (e,g,, TOP VAL > 2 and N SPECS > 5 > etc.) Further, the smaller standard 
deviation of the experimental group on all measures indicated that they were 
being affected by the ceiling more than the control group. 

Even though differences between RAT-DS' and RAT-DS" for experimentals 
and controls were not significant, we would expect that as we learn more 
about these measures they will help us make finer distinctions between stu- 
dents than whether they had or had not chosen the occupation with the highest 
DS, That this sort of reference is necessary is seen from Table V-1, show" 
ing that all of the experimentals and all but one of the controls were able 
to select the highest DS occupations. Correct choice, in other words, is 
not the whole story. We need measures which describe how students synthesize 
information and relate it to the evaluation of occupational attractiveness. 
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TAK-E V-1 



MEANS AND STANDARD DEVIATIONS OF SOC MEASURES^ FALL 1975 
<N=27, College Freshmen) 



X S.D. 

Exp. Con. Exp. Co n . 

TOP VAL 2.5 2.2 0.5 0.8 

W 1/2 1.6 1.6 1.1 1.8 

N SPECS 5.5 5.2 1*3 1.6 

W 3 1.8 2.4 1.5 2.1 

AV CH 1/2 1.2 1.2 0.4 0.4 

RAT-DS' 9.1 9.2 4*0 4.3 

RAT-DS" 8.5 9.5 4.8 3.5 

<r')^ .45 .47 

ir")^ .50 .41 



Percent Choosing Occupation with Highest DS at: 



Experimental Control 
(N = 15) (N ' 12) 



<1) End Phase 1 lOOX 92% 

<13) <11) 

<2) Final 100% 92% 

<15) <11) 
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Despite our failure to see statistically significant group differences 
on our SOC measures, we came away from this latest administration convinced 
that differences In behavior did exist. We did not systematically record 
these behaviors and are thus forced to provide a subjective retelling of 
what we observed. 

It was our Impression that the experlmentals took less time to state 
their specifications, that they stated them more clearly, and that they 
felt more confident about what they said and did. The relevance of the 
time element Is not clear, particularly since a past administration which 
Imposed a time limit seemed to reduce the variation in N SPECS . The clarity 
of specifications was previously measured by N PROBES . As already stated, 
this measure was dropped owing to difficulties in standardizing procedures 
for when and how to probe* This may have been a mistake on our part* What 
is clearly needed is a simple and direct way of measuring how well a stu- 
dent can transmit an informational need to an information-giving source. 
Obviously, this is a mammoth undertaking in Its own right* For now, we 
might find it advisable to return to the use of the N PROBES measure, while 
continuing to improve procedures for standardizing administrators* be- 
havior. 

Students' confidence manifested Itself in several ways. At the most 
obvious level, there was the amount of squirminR and agonizing a student 
did. Aside from this, we found that the experlmentals seemed to be more 
certain of their weights and ratings. Not only did they tend to take less 
time with these tasks, but there seemed to be less indecision on their part 
about where to place the markers and where to put the specification cards 
along the scale. Unfortunately, our previous experience indicated that 
having students rate their confidence levels was not feasible. And while 
the idea of tapping this dimension still seems good, we can see no way to 
do so within the framework of the SOC game. 

Yet another difference in behavior noted between the experlmentals and 
controls was the way each of the groups combined conflicting items of in- 
formation to reach a final decision and make final ratings of occupations* 
The experlmentals frequently ordered the information strips according to 
the Importance attached to the dimension named on the strip. Some of the 
students went a step further by applying a system of weights to the strips. 
Following the model presented in SIGI, they computed desirability sums for 
each of the occupations. The controls, on the other band, were more likely 
to line up information strips with as many "very likely" responses in one 
column as possible, without regard to the Importance of the dimension. 
Obviously, none of the controls attempted to compute desirability sums. 
Consistent with the differences in approach to combining information were 
differences in attitude toward the task and confidence in the final assess- 
ment, Experlmentals seemed to have a strategy for coping with the problem; 
they agonized less and seemed more assured of their final ratings. 
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In short, what seems to have happened In this saga of SOC Is that pro- 
cedures have become progressively more structured. In Its early form, SOC 
was relatively open-ended and difficult for secondary school students. By 
criterion-referenced standards, their performance tended to be poor. They 
left with a recognition that deficiencies In CDM competencies had been 
Identified and defined by SOC, and they expressed resolve to take remedial 
action (e,g.> "I have to do a lot more thinking about my values*'). In Its 
latest, more structured manifestation, SOC was relatively easy for the 
sample of college students, guiding them through a well-ordered and logical 
sequence of tasks so that they learned CDM competencies '*on*line." By In- 
structing these students as they went through It, SOC raised the performance 
of the control group. But the experimental group was held down by a celling 
effect, evidenced by mean scores that could hardly be exceeded In criterion- 
referenced terms and by standard deviations lower than those of the control 
group* 

Although this celling phenomenon In a small sample of college students 
kept group differences below those that would be required to meet the con- 
vention represented by the five percent level, we have nevertheless found 
analysis of Individual scores In criterion-referenced terms quite revealing 
for diagnosis of strengths and deficiencies In CDM competencies. 



Profiles of Representative Students 

To Illustrate the ways In which SOC scores shed light on Individual 
students' strengths and weaknesses In career decision-making, records of 
three students are presented and Interpreted below, (See Exhibits V-1 
through V-3,) Profiles of scores derived from these records are presented In 
Table V-2, A discussion of these profiles follows. 

Student fil (Exhibit V-1) . This student showed up as a good career de- 
clslon^maker on all of the SOC measures. In Phase 1 she named a large num- 
ber of occupational characteristics ( N SPECS = 7), Including all three of 
her top-weighted values ( tOP VAL ■= 3). In addition to belnp, able to name 
specifications. Student fH demonstrated her ability to discriminate between 
them* The characteristics which she herself generated were viewed as more 
Important than the ones selected In Phase 2 ( W l/2= 5.3). Furthemore, she 
assigned a wide range of weights to Indicate the Importance of the differ- 
ent characteristics (from a low of 0 to a high of 8). By the end of Phase 2, 
Student $1 had cove^red all of the occupational characteristics Included In 
the game, leaving W 3 = 0. These scores indicated that she knew her values 
and could express clearly what she wanted In an occupation. 

Student #1 also seemed to understand the correspondence between how 
Important a specification was and hw this figured Into making an occupation 
more or less attractive. Her scores showed high correlations between speci- 
fication weights and marker movements for Phase 1 (_r' ^ .58) and for Phases 
1 and 2 combined (r^^ = ,90). In other words, she tended to make larger 
moves when responding to specifications which were of greatest Importance 
to her and smaller moves for Information that was of less Importance. 

Student #l's ability to use the Information at hand to make logical 
career decisions was also reflected In her AV CH l/2 score of 1.3. The 
moves she made In Phase 1 (in response to specifications which she had 
Identified as being Important) were larger than those made In Phase 2. 
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Flnallyt Student #1 had a low score (3) on the RAT-DS* measure, meaning 
that there was very close agreement between desirability sums and ratings 
for each of the three occupations at the end of Phase 1. A low score on this 
measure indicates that student fil was able to combine irformation and evalu- 
ate occupations so as to determine each occupation's potential for satisfying 
her needs. And in her final rating of occupations, Student iPl chose the one 
with the highest desirability sum. But the RAT-DS'^ of 10 shows that this 
ability did not hold up so well at that point, she apparently allowed her* 
self to be distracted by Phase 2 information, in rating occupation X, even 
though the information concerned three dimensions that she held to be of 
little or no importance (weights of 2, 1, and 0). Thus, X logically should 
have continued to have a negative rating, lower than 2, rather than inter- 
mediate between Y (which maintained top rank) and Z . Perhaps students are 
less concerned with getting second- and third-place ratings quite right than 
with choosing the top-rated occupation. 

Other than that one slip. Student #1 demonstrated the behaviors of a 
very competent career decision -maker, she knew her values and was able to 
generate a large number of important occupational spec if icat ions f she was 
able to discriminate between these specifications, assigning a wide range 
of weights to them; she applied the information she received about occupa- 
tions in a logical manner; and she selected the occupation having the high- 
est desirabilitv> 

Student ^2 (Exhibit V-2) . SOC measures indicated that this student 
was less competent in career decision-making than Student #1. Although she 
made a high number of specifications ( N SPECS = 6) which included two of her 
three top-weighted values ( TOP VAL - 2), there was little variation in the 
weights she assigned to values. Apparently Student #2 was unable to identify 
the values which v/ere most important to her. This was borne out by her W 1/2 
score of 1 which meant that the average weights in Phases 1 and 2 were vir- 
tually the same. The one val^ue which was not selected in Phase 2, leadership, 
was assigned a weight of 6 (W 3 = 6) , a weight which was hip;her than some as- 
signed to Phase 1 and 2 values. 

This lack of ability to discriminate between occupational values was ac- 
companied by a uniform response set on the attractiveness scale to information 
about each value. Invariably Student #2 moved to +8 for "very likely," +5 for 
"possible," and -8 for "very unlikely." Her scores showed no correlation be- 
tween weights assigned to values and marker movement for Phase 1 ( r ^ * 0) or 
for Phases 1 and 2 combined (r^ = 0). In other words, a difference of one or 
two points on the importance scale did not translate itself into a difference 
on the attractiveness scale. Also, because the average weights assigned to 
Phase 1 and Phase 2 values were the same, the marker movement in the two phases 
was the same ( AV CH 1/2 = l.O). 

Although Student #2 selected the occupation with the highest DS at the end 
of Phase 1 and the end of the game, her high RAT-DS scores showed a relatively 
lower agreement between her ratings and the desirability sums for tKe three 
occupations ( RAT-DS ^ = 23; RAT^DS" 18). She was not able to combine informa- 
tion effectively in order to evaluate occupations, primarily because her values 
were undif f erentis' and unclarified. 
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TABLE V-2 

SOC SCORES FOR STUDENTS IN THE FALL 1975 ADMINISTRATION 

Studen ts 



SOC Measures ii *2 #3 

TOP VAL 3 2 2 

W 1/2 5.3 1 1.2 

N SPECS 7 6 4 

W 3 . 0 6 2.5 

AV CH 1/2 1.3 1.0 1.1 

RAT-DS' 3 23 6 

RAT-DS" 10 18 '^^IW 2 

r' .58 0 ^3*"^ .90 

r" .90 0 .90 



CORRECT CHOICE 

End Phase 1 Y "/ Y Y 

End Phase 3 Y Y Y 
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Stu dent ff3 (Exhibit V-3) . Student if3 had a good Idea of what was Important 
to him In choosing an occupation. Although he failed to mention his top-weighted 
value In Phase 1, he did name four Important occupational characteristics 
( N SPKCS 4), Including his other two top values (TOK vAL » 2). His W 1/2 
score of 1,2 showed that, In general, he specified the most Important character- 
istics In Phase 1* Specifications which were not selected were of little 
Importance to him ( W 3 = 2.5). Student #3*s ability to differentiate between 
occupational characteristics was shown by large variation In weights assigned 
to the different values* 

This student also knew how to apply the Information he received. . His' 
Ay CH 1/2 score of 1.1 Indicated that he made somewhat larger moves in Phase 1 
than In Phase 2. This made sense, since Phase 1 specifications were Xhe ones 
he had Identified as being most Important to him. Also, the biggest mpve 
he made was for the characteristic with the highest weight (interest f li^ld , 
weighted 8). Correlations between marker movements and specification weights 
were extremely high (rj = .90; = •SO), reflecting his understanding of the 
relationship between points on the attractiveness scale and weights assigned 
to occupational characteristics, 

Low scores on the RAT-PS measures ( RAT-DS* = 6; RAT"DS_" = 2) provided 
another indication of Student #3's ability to use information logically. There 
was very little discrepancy between computed desirability sums and his ratings 
at the end of Phases 1 and 3. In all three phases he chose the occupation 
with the highest desirability sum. 



155 



ID No. 



EXHTBIT .V-1 
SOC RECORDING FORM 



Student's N 



WT. 



S 
P 
E 
C 
S. 



X 



Y 



ERIC 



Grade/ School 
PHASE 1 



Int<f*""vlewer's Name 



D«te 

PHASE 2 







V 


L 
















/ 


0 










i-a-3 




















1 

hJ 
4> 
4> 
1 








-3 


-3 


♦3 


















-3 






♦3 


♦5" 




















-3 




























FINAL RATINGS 




OTHER CHABACTERISTIC5 


■ 

WT. 




P 
H 
A 
S 
£ 

1 


P 
H 

A 
S 
E 

2 


p 

H 
A 
S 
£ 

3 




























X 














Y 
















7 













ID Mo, 



Jl. 



EXHIBIT V-2 
SOC RECORDING FORM 



student's Nflane 



WI. 

S 
P 
E 
C 
S. 



X 

Y 



erJc 



Grade/ School 
PHASE 1 



OTHER CHARACTERISTICS 


wr. 



























Interviewer's Name 



Date 

PHASE 2 





7 


7 


7 


r 1 














































-? 


-7 
















•5* 


*5 

















7 




— 
















-? 








-2 



FINAL R^INGS 





p 

H 
A 
S 
E 

1 


P 

H 
A 
S 
E 

2 


p 

H 
A 
S 
E 

3 


X 








Y 








Z 









ID No. 



student's N 



Name 



WT. 

S 
P 
E 
C 
S. 



X 

Y 



EiffllBIT V-3 
SOC RECORDING FORM 

Grade/ School 
PHASE 1 



Interviewer's Name 



b 


(9 


V 














i-a-i 


3-1-1 
















0 








































0 















Date 

PHASE 2 







y 














r/ 


0 


-V 









PXHAL RATIttGS 



00 



ERIC 



OTHER CHARACTERISTICS 



Prtshy 



WT. 



Q 


p 

R 

A 
S 


P 
H 
A 
S 


p 

H 
A 
S 




E 
1 


E 
2 


E 
3 


X 




y 


y 


Y 


♦ J 


-3 


-3 




*-3L 







"147- 
EXHIBIT 



SOC DIRECTIONS — FALL 1975 

We're going to play a game designed to test how good you are at making career 
decisions* 

Suppose I have advance Information on three occupations of the future. Let's 
call them X, Y, and The puxpose of the game Is to select one of the three 
to prepare for. So you want to find out how attractive or unattractive each 
of these three Is to you. To do this, you have to tell me what you want In 
an occupation. Then I can tell you how likely It Is -that X, Y, or Z will meet 
your specification. 

As I've said, these are occupations of the future, so don't assume that they will 
correspond to occupations that you are familiar with. Specify the things that 
are most Important to you In choosing the best and avoiding the worst occupation. 

To make this clearer, suppose we were talking about cars, rather than occupations. 
What are your specifications for choosing the best car for yourself? What Is 
most Important to you In choosing a car? 

[Give examples of specifications if necessary. Draw paralltil to 
occupational specifications.] 

Before we begin the game, I'm going to give you a few minutes to think about 
your occupational specifications. Jot down the things that are most Important 
to you In choosing an occupation. 

Do you have any questions? 

[Provide paper and pencil. Give student 3 minutes. 1 
Look at your list. Select the most Important things and ^eclfy them first. 
Phase 1 

O.K., what Is your first specification? 

[Student gives specification. Select Information strip which 

corresponds to distribution on prepared strips. Write subject 

of specification In student's words. Information tells the 

likelihood of obtaining a satisfactory amount or level of thn 

characteristic, according to student^s definition of satisfactory. 

If specification Is job-speclflc or subjective, explain this to the student. 1 

Here Is a scale on which you're going to show me how attractive you find each 
occupation. Each occupation has Its own scale and marker. 

The three markers are now at zero. Indicating that you feel Indifferent about 
the three occupations. If an occupation seems better on the basis of the 
Information you just received, move Its marker up. If it seems worse, move 
It down. If the Information makes no difference, leave the marker where It Is. 
Notice that the scale runs from +10 to -10. The top of the scale 
represents the best occupation you can think of; the bottom represents 
the worst. 

Do you understand? O.K., use the markers. 
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EXHIBIT V-4 (contj 



[Record ratings. Periodically Interpret scale position to student* 
Make sure you both mean the same thing*! 

0*K*, what Is your second specification? 

[Place second answer strip on top of first.] 

I*m going to place this new Information on top of the old* I want you to 
consider this Information by Itself* At the end you will see all the 
Information at once* 

[Return markers to zero*] 
How much better or worse do the three occupations seem on the basis of this 
new Information? 

[Record ratings* Get next spec* Return markers to zero* Repeat 
process until student exhausts specifications* If the student 
reaches six specifications, tell him that he may specify two more 
things before time runs out*} 

[When process is finished, spread out information strips*] 

Now look over all the Information you have about each occupation* Move the 
markers to show how attractive or unattractive each one Is to you* 

[While the student Is doing this, write his specs, on blank cards*] 

Record final ratings for Phase 1* Return markers to zero* Lea^e 

Info* strips In place for student to refer to*] 

Phase 2 

Now I am going to give you cards representing characteristics that you may or 
may not have specified* While I prepare for the next part, Vd like you to 
sort the cards Into two piles: one for characteristics that you*ve specified 
already and one for characteristics that you haven*t specified* You may refer 
to the definition on the back If you wish* 

[Set aside cards of characteristics that student has specified* Remove 
answer strips from Phase 1*] 
Of the cards that are left, I*d like you to select three characteristics 
that are most Important for you to know about* 

[Give Information strips for each characteristic* Repeat 
procedure as before* Then spread out all three Information 
strips for an overall rating*] 
Phase 3 

[Spread out all Information strips from Phases 1 and 2*] 

Now you have all the Information that I am going to give you about the three 
occupations* Consider It carefully. You may move the strips In any way 
that makes It clearer for you* When you are ready, use the scale to 
show how attractive or unattractive you find each occupation. 
(Record ratings oj 
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EXHIBIT V-4 (cont J 

Phase 4 

Here are cards vhlch define characteristics of occupations* They Include all 
the characteristics you specified and chose as veil as the ones you dldn^t 
choose* How Important Is It for you to have each of these things In an 
occupation? 

I would like you to arrange the cards on this scale* Note that 8 means 
of greatest Importance and 0 means of no Importance* Put the cards In 
the pockets which show how Important It Is for you to have a satisfactory 
amount or level of each of these characteristics* 

[Record student's weights* This Is the end of the game* Give 
student feedback about number of characteristics specified In 
Phase 1; relative welfjhts of Phase 1» 2» and 3 characteristics^ 
and change In ratings from Phase 1 to Phase 3*] 
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CHAPTER VI 



SUMMARY, CONCLUSIONS, AKD RECOMMENDATIONS 



The Problem 

A longstanding problem In career development and guidance has been the 
absence of a good Instrument to measure competencies In career decision- 
making (CDM). Previous attempts to develop such measures have taken the 
form of Inventories, questionnaires, and multiple-choice tests that purport 
to tap attitudes tovt5ards CDM, understanding of concepts and principles, 
knowledge of occupational Inf onoatlon , and reasoning about decisions (or, 
more precisely, the ability to select "correct" answers to problems Involv- 
ing hypothetical "cases")* But the operations elicited by the Items are 
often remote from the titles under which the Items are categorized* Further- 
more, none of these Instruments calls for the student to apply his attitudes, 
understandings, knowledge, and reasoning to career decision-making In his own 
Identity* None engages him in the CDM process as himself f making his own 
choices* None evokes or observes behavior based on his own values* Conse- 
quently, none provides a window on the career decision-making process in 
action. Indeed, none is based on an explicit theory of that process; none 
spells out the logjc and sequence whereby the putative componer^ts of CDM ^ 
Interact * 

Rationale for Simulated Occupational Choice 

This report traces the development of a standardized but individually 
administered simulation exercise, called Simulated Occupational Choice (SOC), 
to measure competencies in the process of CDM* 

It is based on the premise that such competencies clearly involve in- 
formation-processing: A competent dec is ion -maker should be able to specify 
what information he needs, should be able to get the information he wants, 
and should be able to use the information he has* 

SOC was designed to elicit such behavioral processes in a CDM context 
and to provide means of observing, recording, and scoring them in ways that 
would be meaningful, particularly for individual diagnosis* 

Other uses envisioned for SOC were to serve aa a criterion for valida- 
tion of group-administered tests or for evaluation of a guidance program or 
treatment* The simulatlot) exercise may also be used for Instructional pur- 
poses with individuals or groups—for example, as the nucleus for a course 
in CDM. 

Development and Tryouts 

During a two-year period, three successive forms of SOC were constructed 
and tried out with secondary school students, and a fourth version was later 
used with a sample of college students. Some of the revisions were made to 
simplify and clarify procedures and materials so that the instrument could 
be administered by people with very little training, administration time 
could be kept within 30 to 45 minutes per student, and observations could 
be readily recorded and quickly converted into scores* Other revisions re- 
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structured the tasks to eliminate unwanted stylistic variance from student 
behaviors, to make observations bear more directly on the competencies be- 
ing assessed, and to derive scores that vould be more meaningful for In- 
dividual diagnosis* 

In the very first form of SOC, students were given the task of choosing 
which one of three unnamed occupations would suit them best* Starting with 
no Information » the student was Instructed to ask the questions that would 
produce Information most helpful In choosing an occupation. As the admini- 
strator provided answers to each question, the student moved markers along 
a scale to show how he then rated each occupation* After five questions 
and answers^ the student was then allowed to ask additional questions, fol- 
lowing the same procedure of rating occupations and eventually assigning a 
confidence estimate to the choice when all of his questions were exhausted* 
Finally, the student was shown a list of kinds of Information available; he 
selected from this list the additional Information he would want to see be- 
fore making his choice of the occupation that would suit him best* rated 
the occupations on each bit of Information, made his choice In the light of 
all the Information he had obtained, and assigned a confidence estimate to 
this final choice. Names of the occupations were then revealed^ and the 
student was encouraged to discuss his choice, the process he had followed » 
and an evaluation of his performance. 

The first field test (Spring 1974), using 39 ninth-graders and 34 
twelfth-graders, immediately demonstrated the virtues of this form of SOC: 
the verisimilitude of the simulation, its evocation of complex and lifelike 
behaviors, the face validity of the tasks, the focus on the students' own 
constructs, the opportunity to ask questions freely, the Inmediate responsive- 
ness of the data base to such questions, and the Instant feedback upon com- 
pletion of the exercise, all served to keep student Interest and motivation 
high. Students were highly Involved in the game, visibly enjoyed it, fol- 
lowed it with many questions about their own actual career decision-making 
and tentative choices, and appeared to learn from the experience. 

At the same time, the scores obtained from these operations were obviously 
unsatisfactory: they represented an effort to pack into summary form rather 
complex chains of interactive behavior* Attempts to Interpret the scores in 
either evaluative or diagnostic terms revealed flaws in the reasoning by 
which they were derived. 

The second field test (Fall 1974) Involved 38 ninth-graders and 34 
twelfth-graders. The revisions undertaken to get better scores made admini- 
stration of this version of SOC much more complex and cumbersome than its 
predecessor. Yet analyses indicated that students still tended to behave in 
a thoughtful and essentially logical way, (For description of procedures 
and materials, see pp* 38^47*) Analysis of the findings ,. however , led to new 
discoveries of ambiguities Inherent in the procedures. For Instance, when 
students asked questions to solicit information about a set of occupations, 
the significance of a given response varied across students* To cite a simple 
example, an annual Income of $12,000 seemed high to some students, low to 
others. Not only were there different points of view, but along some dlmen** 
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sions (e*g* , leisure) a medium return tended to be perceived consistently as 
warranting a more favorable rating than a high return* Thus, while high, 
medium, and low positions along some dimensions of occupational character- 
istics clearly "scale" (e*g* » in the sense that more money is generally pre- 
ferable to less), others do not. When a student asks a question about such 
dimensions as leisure and responsibility, it is not instantly apparent whether 
a high, medium, or lot^ level is preferred* The impact of such individual dif- 
ferences muddied the interpretation of responses and scores* 

Consequently, in the third field test (Spring 1975)* involving 30 ninth- 
graders and 30 twelfth-graders, students made "specifications," stating what 
was desirable to them, rather than asking questions to solicit information* 
Administrators' responses indicated the likelihood that each of the three 
occupations would meet a specification made by students* (For a description 
of procedures, see pp» 80-83*) The three occupations in this version were 
designated as "occupations of the future," so that students would not be 
tempted to try to guess the names of the occupations or to assume that cer- 
tain characteristics perforce go together* Again, students moved markers 
along a scale for each occupation to show the impact of each bit of informa- 
tion taken separately and also the impact of the entire configuration of in- 
formation at different stages* One set of information was provided iti re- 
sponse to specifications generated by students; another set was in response 
to characteristics selected by students from a residual pool* Students also 
assigned numerical weights to each characteristic (generated, selected, or 
residual) to show its relative importance to him* 

The new procedures and directions simplified administration of SOC con- 
siderably* A greater variety of scores were defined to refi^ct operational 
definitions of the various CDH competencies identified ancf thus to provide 
fuller diagnostic interpretation* (For a description of the measures, see 
pp* 94^-96*) Perhaps the most important outcome of this field trial was the 
development of models for diagnostic interpretation of scores* These models 
were illustrated with specific cases, presented to serve as guidelines for 
counselors or other users (see pp* 100-105)* Such diagnostic analyses showed 
considerable power in recapitulating and characterizing differences in stu- 
dents' behavior, illuminating both competencies and deficiencies of individml 
students in CDH* They also tended to highlight, however, some of the remain- 
ing problems in procedures and scores* 

One such problem was the mixture of characteristics of the various 
scales: some were criterion-referenced, others norm-referenced; some were 
continuous, others dichotomized; some were independent, others linked; and 
so on* The cnmolex interactions between scores tends particularly to cloud 
inter-group or inter-individual comparisons. Because the exercise is respon- 
sive to individuals' unique input, performance in one category of competence 
at one stage of the exercise may often depend on conditions generated by per- 
formance at a previous stage* Thus, the information on which different stu- 
dents base their decisions is variable. This is realistic and lifelike, but 
presents a problem for comparisons across persons, since some students face 
easier decisions than others* 
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These problems, although alleviated somewhat in the latest revision, sup-* 
port the emphasis on use of SOC for intra-individual analyses, A given score 
is much more meaningful when viewed in the context of other SOC scores obtained 
by the same student than when extracted from that context for comparison be- 
tween students. 

the most recent version of S<X (as of this writing) was administered in 
Fall 1975 to a small sample of college students comprised of 15 "experlmen- 
tals,*' who had received a guidance "treatment," and 12 ''controls . ** (Revisions 
in procedures are described in pp. 135-136, and scores are described in pp. 136^ 
137.) Differences between these small samples tended to be in the predicted 
direction, but did not reach the five per cent level of significance, mainly 
because of a "ceiling effect'* on the scores of the experimental group. Never^ 
theless, analysis of individual scores ''.n criterion-referenced terms again 
provided remarkable diagnostic insights into students* strengths and deficien- 
cies in the CDM process. 

Importance of Diagnostic Measures 

It seems worth underlining the diagnostic capabilities of SOC, since diag- 
nosis .represents the proudest purpose of measurement in education, and also 
the least practiced, A good diagnostic measure should at least intply guide- 
lines for remedial action, and at best incorporate rtanedlal instruction in the 
very process of measurement. 

To accomplish such a goal, diagnosis depends, ultimately, on a distinct 
theory concerning the structure of the competencies to be learned, the logical 
connections between them, and the sequence in which they are applied. Thus, 
it is based on a series of linked premises; some outcome-'-ln this case, wis- 
dom in CWf — is the product of a number of components; each component makes a 
contribution that can be identified, defined, and measured; a deficiency in 
any one component, or In an interface between components. Is an obstacle to an 
individual's progress toward wisdom in CDM. Recognition of an obstacle can 
then lead to remedial action, or may in itself be the beginning of remedial 
action. 

Indeed, as an Integral part of the administration of SOC, students who 
had just completed the exercise were briefed on the discrepancies between 
their behavior and an ideal of logically consistent and effective behavior 
in CDM. If, for example, they had given higher weights to characteristics 
selected in Phase 2, or to residual characteristics, than to the specifications 
they had initiated in Phase It they quickly recognized that they had been de- 
ficient in explicit awareness of their own values. This recognition in itself 
started them one giant step toward values clarification: *'I hadn*t even thought 
of security, and yet that turned out to be most important thing to me in choos- 
ing an occupation la SOC/* Or if their final ratings were not consistent with 
desirability sums for the three occupations, they realized they had been de- 
ficient in sorting out, manipulating, and Interpreting a mass of Information* 
But what is more, they also realized that in the computation of desirability 
sums, they had been handed a paradigm which they themselves could use in pro- 
cessing information of this kind in the future. Thus, the SOC measures do 
not merely indicate status. They point to actions that can be taken and they 
can start students on an instructional path. 
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Recommendations for Further Research^ Development^ and Application 

Group Instruction . Certainly, efforts should be made to capitalize on 
this usefulness for instruction that has been demonstrated in administrations 
of SOC. Instructional use need not be confined to one student at a time. 
Although group admLnistration of SOC to furnish scores for individuals is 
not feasible, group administration for instruction seems well worth trying. 
Very few modifications would be required. The structure of the simulation 
could be retained for formal classroom use. Materials would have to be en- 
larged to be visible. Then a mixture of collective or consensual responses 
and illustrative individual responses could be elicited from the entire 
group of students. The results could be interpreted and evaluated in group 
discussion, perhaps followed by written critiques by the class members. 

Individual Counseling . The current form of SOC can also be made avail- 
able to counselors for exploratory use with individual students. Counselor 
judgments can be made as to whether the diagnostic interpretations provided 
by SOC are consistent with other observations of a student's status in CDM. 
Even more important^ counselors can judge how helpful the diagnostic^ scores 
are in counseling each student: do such diagnostic interpretations lead 
readily to remedial action and to subsequent progress toward greater wisdom 
in CDM? 

GroLip Comparisons . Notwithstanding the emphasis on diagnosis, additional 
studies comparing treatment and control groups or other groups presumed to 
differ in CDM competencies, should be undertaken. The very small and poorly 
controlled study included in this report (although not supported by the pro- 
ject grant) points up some of the already well known difficulties in con- 
trolling field studies. Nevertheless, appropriate sitttations for larger 
and better controlled projects can be identified or established, if time and 
money enough are available. A small series of such studies may help deter- 
mine more clearly the sensitivity of SOC scores in differentiating between 
groups. Once evidence of the validity of SOC for this purpose has been dem- 
onstrated, even though administration to very large numbers is not feasible, 
careful application of well knoxvn sampling techniques would enable SOC to be 
used as a criterion measure for e*/aluating treatments or programs. 

Relationships with Other Measures . Prior to widespread use of SOC as a 
criterion measure, it would seem appropriate and timely to investigate em- 
pirically the relationships between SOC and other tests that purport to mea" 
store CDM competencies. Instruments such as those mentioned in the first chap- 
ter of this report (e.g., those developed by Crites , Westbrook, and various 
others) should be administered along with SOC to samples of students whose 
scores on some marker test of cognitive abillLxetp (such as verbal aptitude) 
are already available. As a step toward developing a taxonomy of tests of 
CDM competencies, it would be important no find out to what extent these 
various meastires converge with one another and with the marker test. If SOC 
can be regarded as a 'T^etter" criterion than the group-administered tests, 
the partial correlation between each group test and SOC (independent of the 
marker variable) might indicate the group instrument of choice for large- 
scale evaluation of guidance treatments or programs. 
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Note on Availability of SQC 

The current version of SOC can be made available for any or all of 
these purposes at the cost of reproduction* (A single set of the materials 
Is enclosed In an envelope accompanying the report to Training of 

people to administer It can also be offered at cost* It Is estimated that 
persons with no previous knowledge of SOC can be trained to administer It 
within a total of two to three hours In a group setting: one hour for 
Instruction and demonstration^ plus one or two hours of supervised prac- 
tice* 
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APPENDIX A 



SOC INTERVIEW SCHEDULE: ORAL PART 



(used in Field Test 1» Spring 1974) 
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Date; 

Interview t 
Tap« # 



Student ; 
Grade: 
School t 



S*O.C* Interview Schedule: Oral F^rt 

1. What are some of the reaeona why people work? (Expected reply: money.) 

fight boredom 

meet people/fight lonelineas 

help others 

power 

fulfill dreams & goals (accompliahmnt) 

family pressure 

personal enjoyment 

prestige 

learning 

other : 

other: 

other: 
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S.O.C, Interview Schedule: Oral Part 



2. Name an occupation you're thinking of as a possibility. 
What things do you like about it? 

I< Intrinsic 

Pres 

Ind 

Help 

Var 

Lead 

Int 

II* Extrinsic 

Income 

Leis 

Fringe 

Outlook 

Advance 

Security 

III* Concomitant 

Surround 

Conditions 

Activities 

Location 

IV< Requirements 

Early Entry 

Ability 

Occ Train 

Coll Courses 

Pers Qual 

Other Req 

O 

ERJC Sex/Minority 
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S^O.C, Intetvltw Schedule; Oral Part 

3* Is there anything about being a that you dOft't llkfe^ 

I« Intrinsic 

Pres 

Ind 

Help 

Var 

Lead 

j;;^ Int 

II* Extrinsic ^ 

Income 

Leis 

Fringe 

Outlook 

Advance 

Secutlty 

III* Concomitant 

Surround 

Gondltlortia 

Activities 

Locatioti 

IV* Requirements 

Early Entty 

Ability 

Occ ttaiii 

Coll Courses 

Pers Qual 

Other ftec] 

Sex/Minority 
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S.O,C, Interview Schedule: Oral Part 



4. What do you know about youraelf that makea you think you*re qualified to he ;i 
or that youM be a good ? 

Experience (Specifically: ) 

Ability (Specifically: ) 

Recommendation of others {Specifically: ) 

Parents, relatives, or friends are in career 

Other: 



5* No one has all the qualities required for his chosen occupation* What physical, 
mental, or personal qualities of the ideal do you lack? 

Fears/hazards (e.g., nurse & blood, police & death) 

Skills (Specifically: ) 

Patience 

Accuracy 

Endure training 

Efficiency/Self -discipline 

Innovation/creativity/imagination 

Other: 

Other: 



6* Suppose a year from now I met you and you were no longer interested in becoming 

a . Can you imagine any reasons why you might have changed 

your mind? 

Financial problems 

Boy/girlfriend 

Family problems 

School performance 

New occupation info 

Changes in values 

Other : 
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S*0*C* Interview Schedule: Oral Part 



7. What kind of grades should a person have who wants to become a . 

In what school subjects should a person be good ±t he/she waAts to become a 

? 



8* If for some reason you couldn't become a 



^ what would you do 



instead? What alternative plans would you make? 



9* (12th grade only) What are your educational and occupational plans for the 
next two years? 



10, Where can someone who Is Interested in a particular occupation find informa- 
tion about it? 



Counselor 
Reference Book 
Teacher 

Professional Org* 
Other t 



11* Name some of the things that interest you^ some of the things you like to t}o out 
of school* 

Name aome of the aubjifects you like in school^ or that you are good in* 

Are there any other things which you do well that you haveti*t named? (Hake sure 
this is an inclusive list* Then ask;) 

How do these things relate to becoming a ? 



INTERESTS 



RELATIONSHIP 
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S,0,C* Interview Schedule: Oral Part 



12, 



What are the reasons that people finally end up in the occupations they^re in? 
Posit iye/Active Passive/Resigned 



Interest field 

Earn money 

Meet people 

Help others 

Self actualization 
(accompllshiDent) 

Fulfill dreams/goals 

Other: 

Other; 

Other: 



Financial problems 
Family pressure 
Lack training 
Geographic location 
Chance 

Other) 

Other: 

Other: 



13, IM like you to rate yourself on how mature a career decision-maker you think 
you are. 

Think of a friend your age who you think is a mature decisionmaker. What are 
his/her initials? We*ll put them at the top of the scale* 

Think of a friend your age who you think is not a mature decision-maker* ^ What 
are his/her initials? We^ll put them at the bottom of the scale. 

Now think about yourself as a decision-maker. Where do you fit,ln on this 
scaieY Hark the spot with an X, anywhere on the scale from 0 to 10* 



Initials 



Initials 



10 

9 
8 
7 
6 
5 
4 
3 
2 
1 
0- 



A mature decision-maker 



An immature decision -maker 



What are some of the characteristics of a mature career decision«maker? 
(Why do you think XX is a mature, good decision^maker?) 



What are some of the characteristics of an immature career decision-maker? 
(Why do you think YY is not a good decision-maker?) 
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S.O.C. Interview Schedule: Oral Part 

. Throughout the interview w« have talked about you^ your career choices, and 
the important things you expect trem the vork you enter. Thinking 1)i^<^H pver 
all we*ve said, answer the question, *Vhat satisfactions do you want tVom 
working?** Make a complete Uat. 

I. Intrinsic 

Pres 

Ind 

Help 

Var 

Lead 

Int 

II. Extrinsic 

Income 

Lels 

Fringe 

Outlook 

Advance 

Security 

III. Concoml tant 

Surround 

Conditions 

Activities 

Location 

IV< Requirements 

Early Entry 

Ability 

Occ Train 

Coll Courses 

Pers Qual 

Other Req 

Sex/Mlnorlty 
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APPENDIX-B- 



SOC ORAL INTERVIEW SCORER'S HANDBOOK 
December 1973 

(used In Field Test 1» Spring 1974) 
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SOC ORAL INTERVIEW 
SCORER'S HANCBOOK 



BY 

Karen M. Boyle and Gretchen W. Bullock 



December 1973 
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INTRODUCTIOH 



The Interview Schedule is designed to evaluate several criteria 
regarded as Important elements of good decision-making. It accompanies 
administration of the Simulated Occupational Choice (SOC) game, a pro- 
cedure used to measure competence in career decision-making < 

This handbook has been developed to facilitate scoring of the 
oral part of the Interview, (The written part is self-administering 
with scoring based on written responses,) The handbook is divided into 
3 sections: 

1* Explanation of criteria regarded as important elements 
of decision-making, with mention of which questions in 
the oral schedule are used to measure each criterion, 

2. Interviewer Guidelines with a discussion of the inter- 
viewing style to which each interviewer must adhere • 

3, Techniques for Scoring each question on the oral Inter- 
view, with examples of appropriate and inappropriate 
responses. An annotated copy of the scoring form, 
definitions of ten occupational values, and a copy of 
the written interview are attached* 




( 

1. 
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Sectlon 1: Explanation of Criteria 

Five criteria have been selected to measure a student^s decision-making 
ability. 

One crucial criterion (1^) is the degree to which a student Is 
aware of his own values and tHe role of values In making an occupational 
choice. Can he define his values explicitly? Does he perceive connec- 
tions between his values and the characteristics of the options avail- 
able to him? 

Questions 1, 2, 3, 11, and 14 are Included to measure this criterion* 

Another criterion (1^) has to do with Information about these options. 
''Good'' decision-making Implies that the student knows what Information he 
needs, that he can get the Information he wants, and that he can use the 
Information he has* Can he Identify the Information that Is relevant to 
decision-making? Is he familiar with a useful structure of Information? 
Can he locate Information within that structure? Can he recall or repro- 
duce Important facts accurately? Can he Interpret data about options In 
such a way as to reveal their relevance to his values* 

Questions 7 and 10 (plus 8-29 in written section) are Included to 

measure this criterion. 

'*Good" decision-making also requires recognition of reality factors* 
This criterion (1^) i® represented by a knowledge of probabilities of suc- 
cess or failure In preparing for and attaining desired goals. Has the 
student learned to Incorporate predictions with values and Information In 
such a way that predictions are given due consideration but do not domi- 
nate decisions? 

Questions 4 and 5 are Included to measure this crltetlon* 

Another set of criteria (t.) relates to planning* Having tuade a 
tentative occupational choice^ Has the student planned "next steps" that 
are consistent with that choice? Has he formulated hypotheses about the 
outcomes of these "next steps"? Has he developed alternative plans for 
contingencies? Is he prepared to feed outcomes and consequences of pre- 
vlot^s""d"eclslons Into his current decision-making? Does he recognize the - 
potetitial Influence of possible sources of change (e.g., shifts In values, 
revisions In occupational Information, unexpected outcomes In preparatory 
programs)? | j 

Questions 6, 8, and 9 (plus 35 In written section) are Included to 
measure this criterion. j I 

I ^- 
Another criterion (1^) Is an attitude that Is not part of the process 

of decision-making tut may be hypothesized to result from competence In 
decision-making; Is the student actively concerned with exercising control 
over his own declslon-mak^"^g , or Is he passively resigned to the conse- 
quences of forces that he regards as external? Is he confident that he Is 
seeking and taking the path of greatest advantage^ or does he feel that he 
is following the path of least resistance? 

Question 12 (plus Items 30-34 In written section) Is Included to 
measure this criterion* 
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A final criterion Is awareness of the meta- ^dlmenalons of career decision 
mklng> an ability to estimate and explain one's own status as a decision- 
maker . 

Question 13 (plus 36-39 on the x^rltten section) Is Included to measure 
this criterion (I^)* 
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Sectlon 2 ; Interviewer Guidelines 



Interviews are conducted on a one-to-one basis, In a private or seml-prlvat 
room (e.g., library). Those who are not videotaped have their Interviews 
tape recorded and the interviewer also takes notes. 

We take a few minutes to talk with each student before asking the first 
Interview question. We explain what will occur during the interview, en- 
courage the student to answer questions fully^ and assure him/her that there 
are no right or wrong answers. 

We try to adhere to the following guidelines in order to achieve uni- 
formity of interviewing style and to Insure that no student is granted more 
encouragement or explanation than any other: 

1. Present the questions as they are written without rephrasing. 
They have been written in a conversational style. 

2. Once familiar with the questions, maintain maximum eye contact. 

3. Listen: Allow the student a relaxed silence in which he may express 
his ideas* 

4. Appropriate interjections: ''I see,'* a smile, a nod. 
Inappropriate: "Good,** **Great ,** _ *'0h; *' 

5. Allow student to communicate verbally or visually that he is through 
answering a question. Do not asks **Are you through?" **Is that all 
you can think of?" 

6. Appropriate probes: "What do you mean?" '*Can you be more specific?** 
"Can you give an example?** 

Inappropriate: Supplying ideas to the student by rephrasing his 
replies or suggesting alternative interpretations and asking him to 
select one. 

All of the guidelines listed abjve are the goals for the interviewing styl€ 
"In the fell clutch of circumstance " they may not always be possible. We tr; 



1 

William Ernest Henley, **Invlctus," in English Literature and Its Backgrounds 
shorter edition. (New York, 1963>^ p. 1243. 

\ 
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We have attempted to arrange the questions in ai^ order that follows logically, 
as if two people were having a conversation abc-it career choices. For this 
reason, questions that pertain to the same criterion measure may not always 
follow In order. This Is especially true for questions 2, 3, and 14 which 
have a more complex scoring system. 



QUESTIONS 2, 3, & 14: The expected student replies are divided Into categories 
for the convenience of the Interviewers and scorers. The categorle'3 are not 
Iron clad. The three questions are designed to elicit the number of constructs 
the student uses in viewing the world of work. If the Interviewer or scorer 
cannot determine Immediately In which category a reply belongs, jot down the 
phrase and return to classify It upon completion of the Interview. A +1 Is 
given for each different construct mentioned regardless of the category In which 
It is placed. An example of the Items scored In each category Is as follows: 

I. Intrinsic (Satisfactions that are an integral part of the actual work 
activities. ) 



Prestige 

"Be respected or acclaimed by others.'* 

"I want a degree In order to be a step above technician.** (Educatlon>= 
prestige) 



Independence 

'*Be my own boss.** (Independent decisions) 

'*Not have someone looking over me all the time.'* (Little supervision) 



Helping Others* 
"Make people happy.*' 
*'Teach people." 

"Make the world a better place.** 



Variety 

*'Travel to different places." 
"Meet different people.'** 

*'Not do the same thing aljl the tlmf; unexpected things cjome 



Leadership : 

"Have people work for me*'* (Supervise otjhers) 
**Have a chance to give advice.'* (Influence others) 



up. 



Field of Interest (No score = **I like It.** **It appeals to me." 
Interviewer must probe: "What things do you like about It?** 
**Whatj things appeal to you?") 

**I like science." (Specifies field) 
'^People Interest me more than things.'* 
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II • Extrinsic (Rewards that may come as a result of being In a given 
occupation. ) 

Income 

"Financially it*s a good field." 

*'Make enough for a secure life." 

'*Make enough to travel abroad/' 

^ Lelsnre 

"Flexible hours." 

"Work from 9-5, regular schedule," 

"Long vacations." 

**Not too much pressure." 

"No deadlines." 

"Want to have time to be with my family." 

Fringe Benefits 

"Time off when sick," 

Outlook 

"There's a big demand," 

"Not many people going Into the field.'* 

''improve chances with more education." 

Advancement 

"Can move up quickly In the field." 

"I'd like to be self-employed," 
Security 

"A steady job; a steady Income." 

'*N on-seasonal. " 

"Training prepares you for more than one career." (Transfer 

of skills) 
"Can*t be replaced by machines." 



III. Concomitant <A fact true of the occupation, making It more pleasant^ 
but not necessarily a major source of satisfaction.) 

Physical Surroundings 

"Like working out of doors." 

"An office job^ not wl^h machinery." 

'"^^^^ Work Conditions ' 

"Not spend too much time on feet." 
"Not too physically strenuous." 
"Won't be working alone." * 

Activities (Incidental) 

"I like to talk on the telephone." 
"I like walking around." 



Note: Many subjects will mention '^Working with people."' The Interviewer Is 
i^:— ^expected to probe "What do you mean by that? Can you give an example?" The 
studer!: may indicate a desire to 1) help others, 2) have variety^ 3) or work 
> O with cu-workers or team. Those aspects of working with people are marked in 
ERIC the proper categories. 185 
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Lo cat Ion 

"Live anywhere in the country," 
"Work In a warm climate," 
"Work in big cities/' 
'Vork close to home/' 



Requirements 

Early Entry 

"Have already taken a number of courses and am well Into program* 
"Must have a masters/' 

Ability 

"Challenging/' 

"I've always done well In biology/' 

"I'm very good at sports/' 

"I'd like to do something creative/' 

Occupational Training 

"On-the-job tralulng provided by the company/' 
"Can be an apprentice/' 

^ ^ College Courses 

"I'll have to take physics/' 

"I'm enrolling In the nursing program/' 

Personal Qualifications 

"Must be patient/' 
"Must be 21 years old/' 

Other Requirements 

"Must know a foreign language/^ 
"Must pass licensing exam/' 
"Might have to belong to a union/' 

Sex /Minority 

'Vant to be a success as one of the few women In the field/' 
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QUESTION 1: 

Score 0 for no mention. (We expect each student to reply "Money" or 
"to support myself" so no credit Is given for this response.) 
+1 for all appropriate replies except ^'Money"- (Most choices are 
noted on scoring form. An example of one not noted but accept- 
able Is "conformity — because everyone else works/' 

QUESTION 4: (fill In blanks with name of occupation listed in #2.) 
Score 0 for no mention or "strong deslre"> "I'm Interested In It." 

No score Ib given for the response "parents > relatives > or 
friends are In career." The scorer may note that a student 
mentioned thls^ but It is non-scoreable. 
+1 for each response (most choices noted on scoring form) In-* 
dlcatlng the student's awareness of self as It relates to 
his career choice* 

QUESTION 5: (fill In blank with name of occupation listed In #2.) 

Score 0 for no response 

+1 for each response (most choices noted on scoring form) indicating 
the student's awareness of own limitations as they relate to his 
career choice. Any physical deficiencies such as "near-sightedness" 
may be placed under "Other" and receive +1, 

QUESTION 6: (fill in blank with name of occupation listed in #2.) 
Score 0 for no response or "found something I liked better." 

+1 for each appropriate reason the student states (most choices noted 
on scoring form) 

QUESTION 7: (fill in blanks with name of occupation listed in #2.) 
Score 0 for no response or for any inappropriate response. 

+1 for all reasonable responses (even If student names 6 appropriate 
subjects > still score +1 for total score on this question.) 

QUESTION 8: (fill in blank with name of occupation listed in #2.) 

Score 0 for no response or for a vague response such as "I'd get another 
job" or "I'd find something I liked better." 
+1 for naming an alternative educational or career choice » such as 

"Become a computer programmer." 
+2 for naming an alternative and giving detailed plans for pursuing 
It^ such as "Become a computer programaer by enrolling in a data- 
I processing program| at M<jCC." ^ 

QUESTION 9: (Scoreable for l2th grade only) I 

Score 0 for no response or response which indicates intention to avoid 

decision such as "IM think of something." | 
+1 for naming an alternative and giving detailed plans for pursuing 
it. ("IM go to college^ study science to /get into med school" 
or "I*d get a part-time job as a mechanic, if^lle going to night 
school in engineering.") 

QUESTION 10: 

Score 0 for no sources mentlonea 

+1^ f or 1 or 2 apjproprlate sources 
+2 for 3 or more appropriate sources 
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QUESTION 11: (fill in blank with name o£ occupation listed In #2,) 

The interviewer first asks the student to make an inclusive list of his 
favorite activities and subjects in schools. All such responses .^re listed 
in the left hand column marked '"interests". The interviewer then asks the 
student to list as many relationships between those activities and his pre- 
ferred Career goal as he can think of. Those responses are placed in the 
right hand column marked ''relationships , " A line is drawn from each activi- 
ty to each relationship. More than one activity might relate in the same 
way to the career goal^ so the score is the total number of linking lines* 
(See example below*) 

Score 0 if no relationships can be seen no matter how many interests may 
be named* 

Example; Career Goal — Nurse 

Interests Relationships 

candystriper^:^— learn to work with people 

plays piano see a hospital in action 

good in science—- need to study more science later 

on to become a nurse 

Score +3^ since three linking lines have been drawn, 

I 



I 

^ QUESTION 12: (This question will be scored in conjunction with questions 

30-35 in the written section,) 
Score 0 for no response in either column* 

Add up the number of active responses (A), 
Add up the number of resigned responses (R), 
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QUESTION 13: 

Score 0 for no mention or for an inappropriate response ("He's got his 
head together,") 

+1 for mention of 1 or 2 valid characteristics of mature and/or 
immature I 



+2 for menJtion of 3 or more valid characteristics of mature and/or 
I immature. 

Typical valid characteristics are : 

a* knowledge about occupations (has acquired job experience) 

b, planning ahead 

c* ability to give reasons for reaching a given decision 

d* satisfaction with decision made 

e* knowledge of own goals and values 

f* considers ideas and opinions of others^ but makes up own mind 
(not easily swayed by pieer pressure) 

Credit may be given for otht^r appropriate responses that are not mentioned 
above , 
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Intelligence may not necessarily be correlated with maturity in career de- 
cision-making; the validity of this characteristic must be evaluated by the 
interviewer on an individual basis. 

For responses such as **He acts old" or "She acts like a baby" the interviewer 
may probe, "What specific things does he/she do which make you think this 
person is (im)mature?" 



A Final Note: 

Within each question, give only one check for each concept voiced, A 
student may, for example, be able to evidence a desire for independence on- 
the-job by saying "I want to be my own boss,*' "I don't want someone looking 
over my shoulder all the time,*' Give credit for the concept "independence" 
only once per question* 

There may be instances of a student offering responses for one question 
while answering another* The scorer should be alert for such occurrences, 
and record relevant responses in the proper place* For example: in response 
to the question "What do you like about your chosen occupation?" a student 
might interject, "Well, I know a lot of people care about the prestige of this 
career, but X don't." The student is given credit for "prestige" under ques- 
tion //3 "Is there anything about being a \ that you don't 

like?" 
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APPENDIX C 



SOC INTERVIEW SCHEDULE: WRITTEN PART 



(used in Field Test 1, Spring 1974) 



190 



-179- 



S.O.C. Interview Schedule: Written Part 



Name 
Grade 



School 



1. Which of the following occupational groups (A-G) most nearly describes the job 
held by your father or male guardian? If your mother or female guardian Is 
the main support of the family, Indicate the group that best describes her job* 

A. Service workers — such as barbers, cooks, domestics, firemen, policemen, 

waiters , farmworkers , fishermen , lumbermen , laborers , longshoremen , etc. 

^B. Machine operators and related workers — such as apprentices, assemblers, 

railroad brakemen and switchmen, laundry and dry cleaning operators, 
mine operators, packers and wrappers, taxlcab drivers, ifelders, etc. 

C. Craftsmen, foremen, and related workers — such as bakers, carpenters, 

electricians, linemen, mechanics, painters, plumbers, toolmakers, etc. 

D . Clerical, sales, and related vorkers—such as bookkeepers. Insurance 
agents, mall carriers, real estate agents, sales clerks, salesmen, 
secretaries, etc. 

E. Business owners or managers or officials, and farm owners or managers — 

such as contractors, government officials and Inspectors, office super^ 
visors, restaurant owners, retailers, sales managers, wholesalers, etc. 

F. Professional, technical, and related workers— such as accountants, artists, 
clergymen , doctors , engineers , lawyers , scientists , teachers, etc. 

^G. I don^t know. 

2. How much education does your mother or female guardian have? Indlate the 
highest educational level attained. 

A. I Eighth grade or less. ^ / ; 

^B. Some high school. 

C. High school graduate. 

D . Some college, junior cQllege, business or trade school (after completing 

high schcol). 

\ 

E. College graduate. 

^F. Some graduate or professional school. 

^G. Graduate or professional degree. 

H . I don't know. 
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S*0*C* Interview Schedule; Written Part 



3. If you could have your choice and could afford It, choose the one atatetnent 
below which best deacrlbea the amount of education you would like to get; 

(a) Not complete high achool 

(b) Complete high achool 



(c) Complete one, two# or three yeara beyond high school (for example^ 
junior college^ vocational Institute^ or training school) 

(d) Complete a full four^year-college program (Bachelor*a degree) 

(e) Take graduate atudy (Master's degree, doctorate^ law degree) 

<f) Other, specify 



A. Reallatlcally, considering your abllltlest finances, and peraonal situation, 
which of the above la the hlgheat educational level you expect to reach? 

(See a-f In Question 3) 

S. Which of the atatements below beat deacrlbea how definite your career plana are? 

I know exactly the occupation I want to enter. 

I am trying to decide between two different occupatlona* 

I am conalderlng three or more different occupational 

I do not have any specific occupation In mind at thla time. 



6, comparing your gradea to the reat of your claaa (9ph or 12tlji grade), l*i which 
group would you put youraelf? 

. l_ Top fifth 

( Upper fifth 

Middle fifth 

Lower fifth 

Bottom fifth 
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S.O.C. Interview Schedules Written Part 

7* What do you feel are your chances of completing the educational requirements 
necessary for entering your first choice occupation? 



Very high 
Good 
Average 
Below average 
Very low 



9 out of 10 
7-8 out of 10 
4-6 out of 10 
2-3 out of 10 
1 out of 10 



Write brief answers or complete the following statements about the occupation you 
are most Interested In* If you do not have enough Information to answer a question 
write **can't say" under the question. 

Name of Occupation 



8* The major work activities are; a* 

b. 



c* 



9. Amount of contact with other people (such as clients or co-wrkers) Is (check 
one) : 

Great 

Medium 

Small 

Can't Say 

Give an example of the kind of contact with others: 

10* To enter^ you need at least (check one): 

No educational requirements 

2 years beyond high school 

^ 4 years (Bachelor's degree) 

5-6 years (Master's degree) 

7 or more (Ph*D, degree) 

Can't say 

Other (explain) 
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S*0*C* Interview Schedule: Written Part 
lit Some of the required college courses are: 



12* A worker In this occupation should have the following personal qualities: 



13* Are there licensing requirements, state examlnatlond , certificates, or any 
other requirements? 

Yes 

No 

Can't say 



If yes, what? 

14* Typical beginning salary Is $ per year, ^'^ 

The average salary Is $ per year, 

IS* Opportunities for helping otherd are (check one): 

Great 

Medium 

Small 

Can't say 

In what ways can a worker In this occupation help other people? 



16* Opportunities for leadership are (check one): 

Great 

Medium 

Small 

Can*t say 

In what ways does a person In this occupation direct others? 
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S.O.C. Interview Schedule: Written Part 

17. What Interest fleld<8) Is this occupation In? 

Scientific - dsts, knowledge, observations, analysis^ Example: physicist 

Technological - things, machines, mechanical skills. Example: toolmaker. 

Administrative -business, finance, records, systems. Exsmplc: accountant 

Personal Contact - people, selling, supervising* Example: salesman* 

Verbal - words, reading, writing, talking, listening* Example: journalist 

Aesthetic - painting, sculpture, design, music* Example: artist* 

18* How much do other people respect snd look up to members of this occupation: 
A great amount 

A medium amount 

A small amount 

Can't say 

19* The physical surroundings on the job are {check one): 

Office 

Outdoors 

Laboratory 

Store 

Other 

If other, describe: 



20* Typical working hours are: 
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How often would you be expected to work overtime? 

Frequently 

Sometimes 

Rarely 

Can*t say 

Would you work the same hours every day? 

Yes 

No 

^ Can't ssy 195 
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S.O.C. Interview Schedule: Written Part 
21. As a worker In this occupation, how much supervision would you get? 

Very close 

_ Moderate 

Very little 

Can* t say 

22* How much variety does this occupation provide in people, places and activities? 

Variety Level 

Great Medium Small Can' t Say 



People 
Places 
Activities 



23* For the future (S years), the chances of getting a job In this occupation are 
{check one) : 

Good 

Fair 

Poor 

Can' t say 



Why? 



24* Name some businesses or Industries, etc* which employ workers In this occupation. 



25* In this occupation, what are the chances that a worker who does a good job will 
be fired, laid off, or replaced? 

Great 

Medium 

Small 

Can't say 



Is there anything about the occupation that might affect job security? 

Yes 

No 



ERXC If yefl> describe: 
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S.O.C. Interview Schedule! Written Part 

Below are activities related to thinking about occupations* Put an "X*' In the 
squares showing how much time you have spent on each of the sictlvltles. 

Never Sometimes Often 

26* Reading about occupations. 



27. Getting different kinds of wrk experience. 



28. Talking with friends about the kinds of oc- 
cupations^ they are considering. 

29. Talking with adults about occupations. 



For each statement cheqk the response that best describes how you feel. 



Strongly Agree Agree Disagret 

30. 1 wuld follow the advice of a teacher, counselor, 

parent, or friend In planning my career. 



31. Which occupation I enter will be mostly 
a matter of chance. 



32. Everyone seems to tell me something different; 
so I don't know which career to choose. 



33. I will make up my mind about which occupation 
to choose. 



34. In order to plan for a career, I would need to 
know how soon I would be getting married. 



35, There Is plenty of time before I have to start 
thinking about ch'^osing an occupation. 
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S.O.C. Interview Schedulel Written Part 



For the following sentences » mark an X on the part of the scale which completes 
the statement I according to what is true of you* 



36. I know 
<0) 

+ 



Very little 



U) 
-h- 



about occupations* 
<2) 

1— 



An average amount 



(3) 



(4) 



A great deal 



37. X plan ahead 
(0) 

H 



Never 



(1) 
-+- 



(2) 



Half of the time 



(3) 
-+- 



(4) 
+ 



Always 



38* After making an important decision i I 



(0) 

■I- 



U) 



(2) 



Usually 
Don't think 
I've done the 
right thing 



Hope for 
the best 



(3) 
-I- 



(4) 



Am positive 
sure I did 
the right 
thing 



39* Knowledge of my goals and values is 

<0) <1) (2) 

H H h- 



Not clear 



Fairly clear 



(3) 



(4) 
+ 



Very clear 
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APPENDIX D 



STUDENT QUESTIONNAIRE 
(Values Rating Sheet) 

(used in Field Test 1, Spring 1974) 
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School 



Grade 



STUDENT QUESTIONNAIRE 



1. Below Is a list of satisfactions or values that people might consider Important 
In choosing an occupation. Read the definition of the value on the pages 
attached and then show how Inportant It Is to you by selecting a number frocn 
0 to 6 <see the scale below). Place the number In Column 1. EXAMPLE: If High 
Income Is of moderate Importance to you» place the number 4 In Column 1; If you 
can't decide whether Its Importance to you Is slight or moderate^ place the 
ntniber 3 In Column 1. 



Colunn 
1 



Sum of 
Col. 1 



Column 
2 



HKai INGQHB 

PSESTIQ5 

mEBnSNBENCE 

HBIf ING 0THE31S 

SECURITY 

VARIETY 

IZUSSBSRIP 

INTEREST FIELD 

X2ISUK& 

EARLY ENTRY 



SCAI£ 



Importance 
of value 
to you 

None 

SUght 

Moderate 

Strong 

I Greatest 



Rating 



0 
1 
2 
3 

5 
6 

7 
8 



2. Add the numbers In Column 1. If the sum of these numbers does not equal 40 
re-rate the values to make them sum to 40. {Use Column 2.) Do not erase the 
numbers In Column 1. 



3. Check the field that most Interests you. 



^SCIENTIFIC - data» knowledge^ observations^ analysis. Example: physicist. 

TECHNOLOGICAL - things^ machines^ mechanical skills. Example: toolmaker^ 

ADMINISTRATIVE - business » finance » records* systetns. Example: accountant 
PERSCStAL CONTACT - people^ selling, supervising. Examples salesman. 

VERBAL - words, reading^ writing, talking^ listening- Example: journalist 
* AESTHETIC - painting^ sculpture^ design^ music. Example: artist. 
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DEFINITIONS OF THE TEN OCCUPATIONAL VALUES 



HIGH INCOME: Some minlmim Income (enough for survival) is essential for 
everyone* But beyond that, how Important to you are the extras? People have 
different ideas about how much Income Is "high,** Therefore, HIGH INCOME Is 
not defined here as a specific amounts It ineans more than enough to live on* 
It means money to use as you wish after you have paid your basic living ex- 
penses • You can buy luxuries and travel first class* Choose a nuniber C0^8] 
to show how Important It Is to you to find an occupation that pays more than 
what you need to ll^e on. 



PRESTIGE: If people raspect you, look up to you, listen to your opinions, 
or seek your help In community affairs, you are a person with PRESTIGE. Of 
course, PRESTIGE tsn be gained In several ways. But In present-day America, 
occupation is usually the key to PRESTIGE^ Rightly or wrongly, we respect 
some occupations more than others. Choose a number (0-6) to show how Important 
It Is to you to work In an occupation mo6t people look up to. 

INBEPENBENCE ; Some occupations give you more freedom than others to make 
your own decisions, to work without supervision or direction from others* At 
one extrc^me might be talented free-lance artists or writers who may work with- 
out supervision. At the other extreme might be military service or some big 
business organizations with chains of command which severely limit the decisions 
that each person can make« Choose a number (0-6) to show how Important it is 
to you to be your own boss and to make your own decisions about your work. 

HELPING OTHERS: Most people are willing to help others, and show it every day 
outside of their work* They put themselves out to do favors, make gifts, donate 
to charities, and so on. THIS DOES NOT COUNT HERE. The question here is. Do 
you want HELPING OTHERS to be a main part of your occupation? To what extent do 
you want to devote your life work directly to helping people Improve their health t 
education, or welfare? Choose a number (0-6) to show how important it is to you 
to find opportunities for HELPING OTHERS in your occupation. 

SECURITY; In the most SECURE occupations, you will be free from fear of losing 
your job and income* You will have tenure — that is, you cannot be fired very 
easily. Employment will tend to remain high in spite of recessions, and there 
will be no seasonal ups and downs. Your income will generally remain stable and 
predictable; it will not vanish with hard tiroes. Your occupation is not likely 
to be wiped out by automation or other technological changea. Choose a number 
(0-6) to show how Important it is to you to work in an occupation that offers 
steady employment and Income. 



VARIETY: Occupations with the greatest VARIETY offer many different kinds of 
activities and problems, frequent changes in location, new people to meet. 
VARIETY is the opposite of routine, predictability, or repetition. If you value 
VARIETY high, you probably like novelty and surprise, and enjoy facing new pro* 
blems, events, places, and people. Choose a number (0-6) to show how Important 
it is to you to find an occupation that offers ever-changing problems, activi- 
ties, places, and people. 



201 



-190- 



LEADESSHIP: Do you want to guide others, tell them what to do, be responsible 
for their performance? People who weight LEADERSHIP high usually want power to 
control events. They want to influence people to work together effectively. 
If they are mature, they know that RESPONSIBILITY goes with LEADERSHIP. They 
are willing to accept the blame when things go wrong, even though they were not 
at fault. Choose a number (0-^8) to show how important it is to you to direct 
other people in their work and be responsible for their performance. 



WORK IN YOUR MAIN FIELD OF INTEREST: Some people have only one main field of 
interest (Scientific, Technological, Administrative, Personal Contact, Verbal, 
or Aesthetic); others are interested in two or more of these fields. Some in- 
sist that their occupation must be in one of their major fields of interest. 
Others are willing to work in a field that is less interesting; they feel they 
can satisfy their main interest in their spare time. Choose a nuniber (0-8) to 
show how important it is to you to work in one of your main fields of interest 
instead of some other field. 



LEISURE; How important is the amount of time your occupation will allow you 
to spend away from work? LEISURE may include short hours, long vacations, or 
the chance to choose your own time off. To give a high weight to LElST^i- Is 
like saying, "The satisfactions I get off the job are so important t^ ma V'\at 
work must not interfere with them." Choose a i-.umber (0--8) to show ^ow a- 
portant it it to you to be able to take a lot of time off from work. 

EARLY ENTRY: You can enter some occupations with very little education or 
training. Other occupations require years of expensive education. (The cost 
includes loss of income from a job you might have if you were not in school*) 



Think about the time (and money) you are willing to spend on education. Also 
think about your attitude toward school: Is education a satisfying experience? 
Or does it seem like a drag? Choose a number (0-8) to show how important it is 
to you to choose an occupation that you can enter soon, with only a short period 
of education. 
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APPENDIX E 



INTERVIEW SCHEDULE: ORAL PART 
(used in Field Test 2» Fall 1974) 



ERIC 



203 



-192- 



Tnt, Yes 
No 



S,O.C INTERVIEW SCHEDULE: ORAL PART 



Date : 



Tape ff\ 



Student 



Interviewer: 



School: 



Grade; 



Just about everybody works* But not everybody hopes to get the same rewards from work. 
What are some of the rewards, satisfactions, (& so on) that you think people would 
like to get from working? 



fight boredom 

meet people/fight loneliness 

help others 

power 

fulfill dreams St goals 
(accomplishment) 

other: 

other: 



family pressure 

personal enjoyment—Csatlsfy Interests) 

prestige 

learning 

security 



other: 
other: 



2. A* Name an occupation you're thinking about as a possibility* 

What do you like about It? What rewards or satisfactions do you hope to get from 
working In this occupation? 



II, 



Intrinsic 
Prestige 
Independence 
Kelp 
Variety 
Leadership 

Extrinsic 
Income 
Leisure 
Fringe 
Outlook 
Advance 
Security 



III. 



Concomitant 

Surroundings 

Conditions 

Activities 

it* 

Location 



IV, 



Requlreinents 

«■ 

Early Entry 
_ Ability 

Occ* Training 

Coll« Courses 
_ Pers, Qualifications 
_ Other Requirements 

Sex/Mlnorlty 



V, Other 



What characteristics, other than those already mentioned, make this occupation 
seem more attractive to you than others? (Example; Indoors or outdoors) 
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3* What don't you like about being a 



(List all the things you can think of that you dislike about It*) 



I, 



II. 



Intrinsic 

trestlge 

_ Independence 
_ Help 
_ Variety 
_ Leadership 
Interest 



Extrinsic 
Income 
Leisure 
Fringe 

_ Outlook 
Advance 



III. 



IV. 



Conccml tan t V. Other ! 

Surroundings 

Conditions 

Activities 

Location 

Requirements 
_ Delayed Entry 
^ Ability 
_ Occ. Training 
^ Pers. Qualifications 

Other Requirements 

Sex/Mlnorlty 



4, Do you (Did you ever) have a job? If so^ what Is (was) It? (1) 

(2) . When? . 

It? What did you dislike about It? 



What did you like about 



I* Intrinsic 

Prestige 

Independence 

Help 

^ Variety 

Leadership 

Interest 

II* Extrinsic 

Income 

Leisure 

Fringe 

Outlook 

Advance 



III* Concomitant V* Other: 

Surroundings 

Conditions 

Activities 

Location 

IV* Requirements 

Early Entry 

Ability 

Occ. Training 

Pers* Qualifications 

Other Requirements 

Sex/Mlnorlty 



Would you consider this job as a permanent occupation for yourself? Why or 
why not? 
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5. How much do you know about your first choice occupation? 

A lot A medium amount Little or nothing 

How have you gotten your Information? List all the sources you have used> and tell how 
good each was as a source of Information^ e.g. » amount of Information you obtained^ how 
unbiased and accurate It was^ etc* 

Source Excellent Good So-So Poor 

People In the field 

Counselor 

Reference Book 

Teacher 

Professional Org* 

Parent 

Friend or relative 

Other ^ 

6. What qualities are necessary or important for being a 

Ask one ^ time : Which qualities do you possess ? What evidence do you have? Which 
qualities do you lack ? What evidence do you have? 

Important Qualities Possess Lack Evidence 



People change their occupational goals. Suppose a year from now I met you and you no 

longer expected to become a . List all the reasons 

why you might have changed your mind — or why people In general change their minds 
about their occupational choices. 

Financial problems 

Boy/glrlf rlend 

Family problems 

School performance 

New occupation info* 

Changes In values 

Other : 
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8» If for some reason you couldn't become a , what 

would you do Instead? What other occupation would you choose? 



Compare your first and second choice occupation* How are they alike? How are they 
different? 

Alike; Different: 



9. What things do you like about the first that you would also find in the second? 
What things would you dislike in the second that you wouldn't find in the first? 
(If "none," ask: Why would you choose 1 over 2?) 

Like: 



Dislike: 



10. What do you expect to be doing in the next 2 years that will help prepare you to 
enter (occupational field)? 

What college courses; training; apprenticeships; work experience/ ^at program would 
allow you to plan for the first choice and still keep the second open? 



Where can someone who is interested in a particular occupation find information 
about it? 

Prompt: Where would you go for a description of the work activities? salaries? 
working hours? requirements for entry? your own qualifications? conditions of 
work? opportunities and outlook? 

People in the field 

Counselor 

Reference Book 

Teacher 

Professional Org. 



^ Parent, relative, friend 207 
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12. Name some of the things you like to do out of school, Hame some of the subjects 
you like In school, or that you are good In* 

Are there any other things which you do well that you haven't named? (Make sure 
this Is an Inclusive list. Then aski) Now, let*s see If these things relate to 
becoming a and If they do, low? 

Interests : Relationship ; 



13, What are some of things people can do to better their chances of ending up In 
In an occupation that they will like? 

get preparatory experience 

get required training/education 

learn about themselves 

learn about occupations 

^ ask someone* s opinion 

don*t know 

other: 

other : 



14, Have you done anything to Increase your chances of ending up In an occupation you 
will like? Tfes No If yes, what? 

get previous experience 

get required training/education 

^ learn about themselves 

learn about occupations 

ask someone's opinion 

don * t know 

other: 

other : 
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15. What are some of the characteristics of a good career declslon-*niaker? 

Self-rating 

Characteristics Above Av. Av. Below Av. 



Compared to other students your age, rate yourself on each of these characteris- 
tics :(Above Average, Average, Below Average.) 

16, Throughout this Interview we have talked about you, your career choice, and the 
Important things that you expect from the work you enter. Thinking back over 
all you've said, answer the question, "What would an Ideal occupation be like?" 
It doesn't have to b^ a real occupation, but It should Include all the satis- 
factions > all the things you would want from an occupation. If you could have 
everything you wanted. 



Intrinsic 

Prestige 

Independence 
_ Help 
_ Variety 
_ Leadership 



III, Concomitant 

Surroundings 

Conditions 

Activities 

ha cation 



II, Extrinsic 

Income 

Leisure 

Fringe 

Outlook 

Advance 

Security 



IV* Requirements 

Early Entry 

Ability 

Oc?. Training 

Coll. Courses 

Pers, Qualifications 

Other Requirements 

Sex/Mlnorlty 



V, Other: 
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APPENDIX F 

INFORMATION TEST (PABTS A & B) 
(used in Field Test 2, Fall 1974) 
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8/74 



Name : 



Grade: 



School : 



INFORMATION TEST: PART A 



Answer the following questions about the occupation you are most Interested In plan- 
ning for aa an actual career choice , Even If you are undecided, pick an occupation 
that appeals to you. 

Name of occupation 



1, 



2. 
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What are the 2 MOST IMPORTANT work activities that you would perform in this 
occupation? 

(1) = 

(2) 



X don*t know. 



First, check the type or types of contact with other people 
(clients or co-workers) that you would have in this occu- 
pation, and give one specific exacmple for each item checked. 
Then, rate the amount of time spent doing each by circling 
one of the numbers In the columns on the right. 



Counseling 
or treating 



Example ; 



Supervising Example : 



Entertaining Example; 



Instructing Example ; 



Persuading 



Examole ; 



Serving 
(helping or 
assisting) 

Observing 
or monitoring 

Other 
(Specify) 

Does not apply, 
I don* t know. 



Example ; 



Example ; 



Example ; 
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3. To enter this occupation you would need at least (check one): 
No education beyond high school. 

2 years beyond high school, 

4 years (bachelor*s degree). 

5-6 years (master*s degree). 

7 or more (Ph.D. degree). 

Other (Explain; 

I don*t know* 

4. If education or training beyond high school JU needed, list 3 , specif Ic 
courses that would probably be required* 

(1) 

(2) 

(3) 



Name two aptitudes or abilities needed by a person going into this 
occupation. 

(1> 

(2) 



I don*t know. 



Check all of the special requirements listed below which are needed to work 
in this occupation* 

Certificate or license 

Examination to qualify for certificate or license 

Union membership 

Apprenticeship 

None 

Other (Explain: ) 
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7- Check the salary range that Indicates the acverae^ amount of money per 
year earned by people in this occupation- 

$20,000 or more $8,000-$10,999 

$15,000-$19,999 $7,999 or less 

$11,000-$14,999 I don't know- 

8. Check the one statement which best describes the type of help given to 
others by p«^ople in this occupation* 

Works with people directly to improve their health, welfare, or 

education, 

Makes life better for the general public in a significant way. 

Provides a service that makes life more convenient or pleasant* 

Helping others is not a major purpose of the work, 

I don't know* 

If appropriate, give an example of a "helping-others** activity for the 
statement you checked: 



9^ Check the one statement which best describes the degree of leadership 
exercised by a person in this occupation* 

Has great influence on policy-making decisions or on the lives 

of many others* 

Is responsible for a large number of employees or has considerable 

influence on others* 

Supervises a small group of workers or has moderate Influence 

over others* 

Has little or no influence over other workers or clients* 



I don* t know* 



If appropriate, give an example of a leadership activity for the statement 
you checked; 
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10* In which of the following fields of Interest does this occupation belong? 
(If you mark more than one, number 1st, 2nd, 3rd, In Importance.) " 



Sclentif Ic^data, knowledge, observations, analysis, mathematics* 

Technological — things, machines, manipulative and mechanical skills. 

Administrative — business, finance, records, systems. 

Personal Contact — people, selling, supervising, persuading* 

Verbal — words, reading, writing, talking, listening* 

Artistic — painting, sculpture, design, dance, music, the Fine Arts* 

I don't know* 



11* Check one statement which best describes the prestige of this occupation* 
People tend to look up to or respect members of this occupation* 

People neither respect nor disrespect members of this occupation* 

People tend to look down on or disrespect members of this occupation, 

I don' t know* 



12* Check the work setting In which most activities for this job are performed* 



Indoors 
Office 

Laboratory 

Store 

Classroom 

Hospital 

Studio 

Workshop 

Factory 

Other Indoor setting 
(Specify; 



Outdoors 
Park 

"In the field" 
Forest 

Body of water 

Farm 

Gardens 

Other outdoor setting 
(Specify: 



I don't know* 
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13. Check all of the following special features which apply to work in this 
occupation* 

Most of the work is done standing or moving about. 

Most of the work is done sitting* 

You must take safety precautions to protect yourself from injury. 

The area in which you work may be noisy. 

The work requires liftit^ig, carrying, moving heavy objects* 

The work requires climbing, crawling, stooping, bending* 

I There are no special features of the type listed above. 

I don*t know* 



14. Check the dress regulation^ which usually apply to persons in this occupation. 

You are required to wear a uniform or special work c^lothes* 

You are required to look neat and presentable. 

There are ne dress requirements* 

I don*t know* 

13. Check the statement which best describes the work schedule in this occupation, 

The work schedule is fixed; you must account for all your time* 

You must accomplish a certain amount of work, but you are not 

required to keep to a strict time schedule* 

You may schedule your work as you wish, and there are no re** 

quirements as to how much work you must accomplish* 

Other (describe) 

I don't know* 
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16^ For each of the four categories related to mrklng time, check the 

statement below which best describes the occupation you are consider-* 
Ing. 

(1) Work Days: 

Work usually done on weekdays^ Monday through Friday; al- 
most never on weekends. 

Weekend work Is occasionally required. 

Weekend work Is frequently required. 

I don't know. 



(2) Shift Work: 

(Working hours other than approximately 9 a.m. to 5 p.m.) 

Shift work Is frequently required. 

Shift wrk Is rarely required. 

I don' t know. 



(3) Overtime: 

Overtime work Is frequently required. 

Overtime work Is occasionally required. 

Overtime work Is rarely or never required. 

I don't know. 

(4) Night Work: 

Night work Is frequently required. 

Night work is rarely required. 

I don' t know. 



17. Check the one statement which best describes the amount of supervision 
usually received by i^rkers in this occupation. 

Work without supervision; plan own work; seldom evaluated 

by others. 



Supervised weekly; follow overall assignments. 

Supervised dally; vrork under supervisor who as^tlgns and schedules 
work; free to decide details of work. 

Supervised hourly; activities are directly supervised with little 
opportunity to act on your own. 



Er|c I don't know. 
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18. In each of the three cstegorles below, check the ststement which best 
describes the opportunities for vsrlety In this occupstlon. 

(1) Variety In People: 

Meet and deal with ma ny different people during a work day* 

^ Meet or deal with a few different people during a work week. 

Meet or deal with the same people every day. 

I don't know. 

(2) Variety In Places: 

Work In many different work settings or travel to many dif- 
ferent places. 

Usually work In the same setting, with occasional outside 

meetings or trips to other places. 

No change In work setting. 

1 don't know. 



(3) Variety In Problefms: 



Work activities change frequently; must deal with the un^ 
expected. 

Major work activities are the same, but some minor variations 
may occur. 

Work activities follow a set routine which Is repeated every 
day. 

1 don' t know. 



19. Check the one statement which best describes the future employment proi>- 
pects for workers in this occupation. 

Excellent: Strong demand for workers; shortage of qualified 

people. 

Good: Steady demand for workers. 

Fair: Demand limited except in certain geographic areas OR 

demand is decreasing due to automation or economic conditions. 

Poor: Little demand, if any; the career is very overcrowded, 

and few jobs are available. 

I don't know. 

217 



ERIC 



Part A 



-206- 



ERIC 



20* In which one of the following places Is a person In this occupation 
most likely to get a job? 

Federal Government School 

Local Government Uospltal or medical office 

Industry Self-employed 

Business Other (Specify) 



I don^ t know* 



21* How much security would you have In this occupation? Check all of the 
following statements that describe the occupation you have named* 

You would be guaranteed a job no matter what else happens* (For 

example^ you would have a permanent contract^ tenure^ or be pro- 
tected by a union agreement*) 

You would have no guarantee that you would keep your job* 

Your job would be permanent and year-round* 

Your job would be seasonal, 

Your job would probably not be replaced by i machine or computer, 

A machine might take over jobs In this occupation* 

You would be employed for most of your adult llfe^ up to the 

standard retirement age of 65* 

Your occupation emphasizes youth and strength^ so you prob- 
ably could not be employed In this career past the age of 
30 or 35* 

I don^t know. 



22* Name an occupation similar to the one you are presently considering* 
Similar occupation: 



Write three kinds of rewards or satisfactions that you could get from 
both your first choice occupation and the one you just named* 



(1) 

(2) 
(3) 
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Name; 



Grade:; 



School: 



INFORMATION TESTi PART B 



Which one of the following occupational groups most nearly describes the job 
held by your father or male guardian? If your mother or female guardian Is 
the main support of the family, Indicate the group that best describes her job* 



Service workers"such as bp.rbers, cooks, domestics, firemen, policemen, 
waiters , farmworkers , fishermen , lumbermen , laborers , longshoremen , etc* 

Machine operators and related workers — such as apprentices, assemblers, 
railroad brakemen and switchmen, laundry and dry cleaning operators, 
mine operators, packers and wrappers, taxlcab drivers, welders, etc* 

Craftsmen, fcre^men^^ and related worker s-^-such as bakers, carpenters, 
electricians , linemen, mechanics , painters , plumbers , tpolmakers , etc* 

Clerical, sales, and related workers'-'-such as bookkeepers. Insurance 
agents, mall carriers, real estate agents, sales clerks, salesmen, 
secretaries, etc* 

Business owners or managers or officials, and farm owners or managers — 
such as contractors, government officials and Inspectors, office super- 
visors, restaurant owners, retailers, sales managers, wholesalers, etc* 

Professional, technical, and related workers — such as accountants, artists, 
clergymen, doctors, engineers, lawyers, scientists, teachers, etc* 

I don't know* 



2* How much education does your mother or female guardian have? Indicate the 
highest educational level attained* 



Eighth grade or less* 
Some high school* 
High school diploma* 

Some college, junior college, business or trade school (after completing 
high school)* 

College degree* 

Some graduate or professional school* 
Graduate or professional degree^ 
I don*t know* 




Copyright (C) by Educational Testing Service* All rights reserved* 
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3. If 70U could have your choice and could afford lt» choose the one atateaant 
balow which best describes the amount of education you would like to gett 

(a) Not complete high school 

(b) complete high school 

(^) Complete one, two, or three years beyond high school (for example. 

Junior college, vocational Institute, or training school) 

(d) Complete a full four-year-college program ( bachelor's degree) 

(e) Take graduate study {master*s degree, doctorate, law degree) 

(f) Other, specify 



4« Realistically, considering your abilities, finances, and personal situation, 

which of the levels listed In Question 3 Is the highest educational level you 
expect to reach? 

(Use letter, a-f, from Question 3) 

S« Which of the statements below best describes how definite your career plans are? 

I know exactly the occupation I want to enter^ 

_ ^ ^ ^ I am trying to decide between two different occupations. 

I am considering three or more different occupations* 

^ I do not have any specific occupation In mind at this time* 

6* Comparing your marks to the rest of your class <9th or 12th grade). In which 
group would you put yourself? 

Top fifth 

Upper middle fifth 

Middle fifth 

Lower middle fifth 

Bottom fifth 



7* What do you feel are your chances of completing the educational requirements 
necessary for entering your first choice occupation? 



Very high 
Good 
Average 
Below average 



Q Very low 
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9 out of 10 
7-8 out of 10 
4-6 out of 10 
2-3 out of 10 
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Below are activities related to thinking about occupations* Put an "X" In each row of 
the box showing how njuch time you have spent on each of the activities* 

Never Sometimes Often 

8« Reading about occupations* 

9* Getting different kinds of work experience* 



10* Talking with friends about the kinds of oc- 
cupations they are considering* 

11< Talking with adults about occupations* 



For each statement check the response that best describes how you feel* 

Strongly Agree Agree Disagree 

12* I would follow the advice of a teacher, counselor, 

parent, or friend In planning my career* 

13* Which occupation I enter will be mostly 

a matter of chance* . 



14* Everyone seems to tell me something different; 
so I don't know which career to choose* 



IS* I will make up my mind about which occupation 
to choose* 

16* In order to plan for a career, I would need to 
know hcv soon I would be getting married* 



17. There Is plenty of time before I have to start 
thinking about choosing an occupation* 
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For the following sentences, mark an X on the part of the scale which completes 
Che statement, according to what is true of you. 



18. I know 
(0) 

+ 



Very little 



(1) 
-+- 



about occupations ^ 
(2) 

—I— 



An average amount 



(3) 



(4) 



A great deal 



19. I plan ahead 
(0) 

H 



Never 



(1) 
-h- 



(2) 
-h- 



Half of the time 



(3) 
-h- 



(4) 



Always 



20. 



After making an important decision^ I usually 



(0) 



(1) 
-h- 



(2) 
+ 



don't think 
I've done the 
right thing 



hope for 
the best 



(3) 
-1- 



(4) 



am 

sure I did 
the right 
thing 



21. My knowledge of my goals and values is^ 
(0) (1) (27 



Not clear 



Fairly clear 



(4) 



Very clear 



r 
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APPENDIX G 



MANUAL FOR INTERVIEWERS 



(used in Field Test Ifl^ Fall 1974) 
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MANUAL FOK INTERVIEWERS 



An Interview-questionnaire has been developed for evaluating several 
criteria regarded as Important el^.ents of good career declsion-maklngt 
The Interview records Ss' responses to the Interview section* Ss write In 
their own responses to the questionnaire section, which has two parts. 
Part A of^the questionnaire Is designed to assess a student's knowledge 
about his first choice occupation. Part B asks for background biographi- 
cal Information and Includes questions assessing the student's attitudes 
and opinions about career decision-making. The oral Interview, though 
structured, gives students an opportunity for free responses which show 
the statiis and nature of their thinking about career declfilons* It must 
be administered by Interviewers trained to convey questions In a uniform 
manner , 

This handbook has been developed to guide Interviewers In administer- 
ing and scoring the oral part of the Interview, and In scoring the written 
parts of the questionnaire. There are three sections: 

1, EXPLANATION OF CRITERIA, The Important elements of decision- 
making to be measured are described, with a mention of which 
questions were designed to measure each criterion, 

2, ADMINISTERING THE INTERVIEW , Suggestions for a uniform In-- 
tervlewlng style are given, with questlon-by-questlon examples 
of responses which would be Inappropriate or would require 
further explanation, and the probes which would be allowed, 

3, GUIDELINES FOR CODING AMD SCORING , The number of points al- 
lotted to each question Is Indicated, with examples of good, 
poor, or borderline responses. An annotated copy of the In- 
terview Is attached. Indicating the method of scoring each 
question , 



To avoid awkwafdnesst this Manual folloifs the convention of using the 
masculine form of the third-person singular pronoun to refer to either 
sex. 
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Sectlon 1; EXPLAMATIOW OF CRITERIA 

Six criteria have been selected to measure a student*s career de- 
cision-making ability* Listed below are the six criteria and the questions 
on the oral Interview and the written questionnaire which were designed to 
measure those criteria* 

Ij^ Constructs 

One crucial criterion Is the degree to which a student Is aware of his 
own values and the role of values In making an occupational choice. Can he 
define his values explicitly? Does he perceive connections between his 
values and the characteristics of the options available to him? How rich 
or Impoverished are the dimensions along which he construes occupations? 
Does he perceive many or few such dimensions? 

Questions 1, 2, 3, 8, 9, and 16 (plus part A Hi In the written section) 
are Included to measure this criterion. 

In addition to Intrinsic Satisfactions and Extrinsic Rewards, the con- 
structs listed on the scoring grid Include some concomitant satisfactions 
and requirements frequently mentioned by students. The written question 
iH2 asks for three satisfactions to be obtained from both a first and second 
choice occupation. 

Although Question 4 was also designed to elicit comments on Criterion I 
(Constructs), It Is not added Into the sum of these scores because 9th 
graders who are less likely to have held a job or to have had any work 
experience would be unfairly penalized. Those who have worked, however, 
may be aware of values, satisfactions and drawbacks not thought of by those 
who never worked. Including the question In the Interview makes It possible 
to collect data which may be used at another time* 

I2 Information 

Another criterion has to do with Information about options • "Good" 
decision-making Implies that the student knows what Information he needs, 
that he can get the Information he wants, and that he can use the Information 
he has* Can he Identify the Information that Is relevant to decision-making? 
Is he familiar with a useful structure of Information? Can he locate In- 
formation within that structure? Can he recall or reproduce Important facts 
accurately? Can he Interpret data about options In such a way as to reveal 
their relevance to his values? 

Questions SB and 11 of the oral Interview (plus 1-21 In Part A of 
the written questionnaire) are Included to measure this criterion* 

SB and 11 on the oral Interview were designed to show an awareness of the 
sources of occupational Information* Part A: 1-21 of the written questionnaire 
asks for the amount of specific detailed Information the student actually has 
on Important aspects of his first choice occupation. 
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Reality 

"Good" decision-making also requires recognition of reality factors. 
This criterion is represented by a knowledge of probabilities of success 
or failure in preparing for and attaining desired goals. Has the student 
learned to incorporate predictions with values and information in such a 
way that predictions are given due consideration but do not dominate de- 
cisions? 

Questions 6 and 12 of the oral interview are included to measure this criterion. 

Question 6 asks first: "What qualities are necessary or important 
for being a ?" Then the student is asked whether he pos- 
sesses or lacks the qualities he deems necessary. Question 12 uses the 
reverse approach: "Name some of the activities or subjects that you like 
or do well in," Then> "Are they related to the career of your choice?'' 
If the student is realistic^ presumably he will not have chosen a career 
for which he has no talent or liking. 

Planning 

Another set of criteria relates to planning. Having made a tentative 
occupational choice, has the student planned "next steps'' that are con- 
sistent with that choice? Has he formulated hypotheses about the outcomes 
of these "next steps"? Has he developed alternative plans for contingencies? 
Is he prepared to feed outcomes and consequences of previous decisions into 
his current decision-making? Does he recognize the potential influence of 
possible sources of change (e,g,, shifts in values, revisions in occupa- 
tional information, unexpected outcomes in preparatory programs)? 

Questions 7, 10, 13, and 14 of the oral interview (as well as Part B: 17, 
and 8-11 in the written section) are included to Treasure this criterion. 

Question 7 asks why people might change occupational goals. Question 
10 asks about the student's plans for the next two yearns and the possibility 
of keeping secondary options open. Question 13 raises the notion of what 
people in general can do to improve their career plaming* Question 14 
asks what steps the student himself has already taken. 

The written questions ask the student to show the amount of time he has 
spent in important aspects of planning, 

I J Control 

Another criterion is an attitude that is not part of the process of de- 
cision-making but may be hypothesized to result from competence in decision- 
making: Is the student actively concerned with exercising control over his 
own decision-making, or is he passively resigned to the consequences of 
forces that he regards as external? Is he confident that he is seeking and 
taking the path of greatest advantage, or does he feel that he is following 
the path of least resistance? 
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Questions 12-16 in Part B of the written questionnaire are included to 
measure this criterion. They seek to determine the student's attitudes 
about the amount of control he would or could exercise. 



^6 Awareness 

A final criterion is awareness of the m^ta- dimensions of career decisions- 
makings an ability to estimate and explain one's own status as a decisions- 
maker. 

Questions 5a, 15a, and 15b (plus Part B: 7 and 18-21 on the written 
section) are included to measure this criterion. 

Question 5a involves a self-rating of the state of the sttldent's informa* 
tion about the career he has chosen (which can be compared with his actual 
rating on the information questionnaire). Question 15a asks for the student's 
concept of the characteristics of a good career decision-maker, 15b requests 
that he rate himself on these characteristics. 

Part B: 7 and 18-21 on the written section involve self*-ratings of the 
characteristi cs considered to be important in career decision^naking^ some of 
which the student may not have mentioned in the oral interview. 

Section 2; ADMINISTERING THE INTERVIEW 



The oral interview is administered before the written questionnaire so 
that the student will not be influenced by the written questions. 

Interviews, which are conducted on a one-to-one basis ^ in a private or 
semi-private room such as library, small office, or corner of the guidance 
facility, may last from half an hour to an hour, depending on the student. 
All interviews are tape-recorded, and the interviewer also takes notes. Note- 
taking is simplified for some questions by having the interviewer check a 
prepared list of the most frequent responses* In other cases, the interviewer 
must write down key phrases. 

Students are assured that the tapes are for research purposes only and 
will be kept absolutely confidential. The recordings are useful mainly for 
training interviewers, for developing and testing interview-rater reliabi- 
lities, and for reviewing a student's exact response. 

Before asking the first question^ interviewers take a few minutes to talk 
with each student to explain what will occur during the interview. Students 
are told that there are no right or wrong answers, and are encouraged to re- 
ply to each question as fully as possible^ even repeating information given 
for a previous question If necessary. They are also told that they may have 
all the time that they wish, and should indicate to the interviewer when they 
have finished answering a question and would like to go on. 
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Guldellnes 

In order to achieve uniformity of interviewing style and to insure that 
no student is granted more encouragement or explanation than any other» in*- 
terviewers should try to adhere to the following guidelines: 

1* Present the questions as they are written without rephrasing* 
They have been written in a conversational style, 

2. Once familiar with the questions, maintain maximum eye contact, 

3. Allow the student a relaxed silence in which to express his 
ideas ^ 

4. Avoid evaluative comments such as "Good," ''Great," "Ohl" To 
acknowledge a reply say, "I see," or simply smile or nod, 

5. If the student pauses, do not ask: "Are you through?" or "Is 
that all?" Wait for verbal or visual cues that he is 
through answering a question* 

6. When students answer with generalizations that may need clari- 
fication, the interviewer may probe: "What do you mean?" "Can 
you be more specific?" "Can you give an example?" It is in- 
appropriate to supply ideas to the student by rephrasing his 
replies or suggesting alternative interpretations and asking 
him to select one* 

Examples of responses requiring further explanation: 

"I like it," "It's satisfying,. , rewarding, fun/' "It appeals 
to me," or ''It's boring>" 

Probe: l^at things do you like about it?" "^That is boring about 
it?" (The answer may reveal that the student was referring to 
field of interest, the amount of variety, or kinds of activities*) 

"Dealing with people," 

Probe; "For what purpose would you be dealing with people?" or 
"Can you give an example of what you mean by 'dealing with people'? 
(The answer might reveal that the student meant helping people, 
seeing a variety of people, or working with others rather than 
alone * ) 
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Section 3: GUIDELINES FOR CQPIMG AND SCORING 



Scoring varies from question to question on both the interview and 
the questionnaire. Therefore, scorers must check the method of scoring each 
question as they go along. 



Interview 



Note that when recording answers, interviewers should give only one 
point for each concept expressed. For example, a student may say, **I want to 
be my own boss,'* and "I don't want someone looking over my shoulder all the 
time,** Give credit for the concept **independence'* only once, 

QUESTION 1: 

1* Just about everyone works. But not everyone hopes to get the same 
rewards from work. What are some of the rewards, satisfactions, (fit so on) 
that you think people would like to get from working? 



fight boredom 

meet people/fight loneliness 

help others 

power 

fulfill dreams fit goals 
( ac comp lis hmen t ) 



family pressure 

personal enjoyment— 
(satisfy interests) 

prestige 
learning 
security 



other ; 
other; 



other: 
other; 



This question is included to measure the student's awareness of tha many 
constructs in the world of work, (I^) Assign one point (+1) for each separate 
construct named. No score is given For '*money" because almost everyone mentions 
it. Other than this, all reasonable responses are included in the scoring. 

Scoring; No idea = 0 

1-2 ideas = +1 

3 or more ideas " +2 

Scores for this question will be no higher than +2, 
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QUESTIOM 2: 



2. A. Name an occupation you're thinking about as a possibility. 



What do you like about It? What rewards or satisfactions do you hope to 
get from working In this occupation? 



I* Intrinsic 



Prestige 

Independence 

Help 

Variety 

Leadership 

Interest Field 



II* Extrinsic 

Income 

Leisure 

Fringe 

Outlook 

Advance 

Security 



II I * Concoml t an t 

Surroundings 

Conditions 

Activities 

Lo cation 



IV. Requirements 

Early Entry 

Ability 

Occ. Training 

Coll. Courses 

Pers- Qualifications 

Other Requirements 

Sex/Minority 



Other 
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What characteristics, other than those already mentioned, make this 
occupation seem more attractive to you than others? (Example; 
Indoors or outdoors) 

This question is another way of getting at the student *s awareness 
of the many constructs in the world of work (Ij^)» 

One point (+1) is assigned for each separate construct named ^ Each 
construct should be counted only once, however, no matter how many 
times a student may refer to it or how many examples or refinements 
of that construct he may mention. 

The score for this question is the sum of the points assigned* 
Scores for this question typically fall in the range of 1 to 6. 

Examples of appropriate responses for the categories listed on the 
Interview form are given below* 
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I- Intrinsic (Satisfactions that are an Integral part of the actual work 
activities , ) 



Prestige 

''Be respected or acclaimed by others," 

"I want a degree In order to be a step above technician," (Education ^ 

prestige) 

"Be a big man," 

Independence 

"Be my oira boss," (independent decisions) 

"Not have someone looking over me all the time," (Little supervision) 

Helping Others 
"Make people happy," 
"Teach people," 

"Make the world a better place," 
Variety 

"Travel to different places," 
"Meet different people," 

"Not do the same thing all the time; unexpected things come up," 
Leadership 

"Have people work for me," (Supervise others) 
"Have a chance to give advice," (influence others) 
"Not too much responsibility," 

Interest 

"I like science," (Specifies field) 

"I like animals," 

"I like to sing and act," 

(No score If probe for more specific explanation of "I like It" 
yields nothing additional,) 



II, ExtriLnslc (Rewards that may come as a result of being in a given occupation) 
Income 

"Financially it's a good field," 
"Make enough for a secure life," 
"Make enough to travel abroad," 
"Make enough to take care of my family," 

Leisure 

"Flexible hours," 

"Work from 9-5, regular schedule," 

"Long vacations," 

"Not too much pressure," 

"No deadlines," 

"Want to have time to be with my family," 
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Frinjge Benefits 
"Time off when sick/' 

Outlook 

"There's a big demand*'* 

"Not many people going into the field/' 

"Improve chances of getting a job with more education/' 

Advancement 

"Can move up quickly in the field/' 
"I'd like to be self-employed/' 

Security 

"A steady job; a steady income/' 
"Non-^seasonal/' 

"Training prepares you for more than one career/' (Transfer of skills) 
"Can't be replaced by machines/' 



III, Concomitant (A fact true of the occupation, making it more pleasant, 
but not necessarily a major source of satisfaction*) 

Physical Surroundings 

"Like working out of doora , " 

"An office job, not with machinery/' 

"Air-conditioned office/' 

Work Conditions 

"Not spend too much time on feet/' 
"Not too physically strenuous/' 
"Won't be working alone/' 

Location 

"Live anywhere in the country/' 
"Work in a warm climate/' 
"Work in big cities/' 
"Work close to home/' 



IV* Requiremen ts 

Early Entry (or the negative "Delayed Entry" on question 3) 

"Have already taken a number of courses and am well into program/' 

''Myst have a masters/' 

"Would like it because only requires high school diploma/' 
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Ability 

"Challenging," 

"Work at a higher level/' 

"I've alvays done well In biology," 

"I'm very good at sports." 

"IM likie to do something creative/' 

"No problems." 

"Not enough thought," 

Occupational Training 

"On-the-job training provided by the company.'' 
"Can be an apprentice." 

College Courses 

"I'll have to take physics," 

"I'm enrolling in the nursing program.'^ 

Personal Qualifications 
"Must be patient." 
"Must be 21 years old," 

Other Requirements 
"Must know a foreign language." 
^'Must pass licensing exam." 
"Might have to belong to a union," 

Sex/Minoritv 

"Want to be a success as one of the few woman in the field." 



Other 

In addition to bona fide "Other" values, a few replies, not considered 
to be of the same calibre of those given above, yet meriting some 
recognition, were given one point (+1) under "Other*" Such phrases 
as "Doing a good job," "Getting the job done," '^eing a success," or 
others expressing some desire for self-actualization are examples. In 
the future, it might be wise to probe for further clarification of such 
answers , 
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QUESTIONS 3 and 4: 



3. What don't you like about being a 



ERIC 



(List all the things you can think of that you dislike about It.) 



I. Intrinsic 



Prestige 

Independence 

Help 

Variety 

Leadership 

Interest 



III. Concomitant 
Surroundings 

Conditions 

Activities 

Location 



V. Other: 



II. Extrinsic 

Income 

^ Leisure 
Fringe 



Outlook 
Advance 
Security 



IV. Requirements 

Delayed Entry 

Ability 

Occ. Training 

Pers. Qualifications 

Other Requirements 

Sex/Minority 



4. Do you (Did you ever) have a job? If so, what Is (was) It? (1)^ 



(2) 



When? 



about It? What did you dislike about It? 



What did you like 



I. Intrinsic 



Prestige 

Independence 

Help 

Variety 

Leadership 
Interest 



III. Concomitant 

Surroundings 

Conditions 

Activities 

Location 



V. Other; 



II* Extrinsic 

Income 

Leisure 

Fringe 

Outlook 

Advance 



IV ^ Requirements 

Early Entry 

Ability 

Occ. Training 

Pers. Qualifications 

Other Requirements 
Sex /Minority 
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Would you consider this job as a permanent occupation for yourself? Why or 
why not? 



Scoring for both these questions Is exactly the same as for QUESTION 2. 
For QUESTION 3, the scores typically fall between 1 and 5. For QUESTION 4, 
scores range from 0 to 7. 

Note that the score for QUESTION 4, although dealing with Constructs, Is not 
Included In the summation for Criterion 1» as explained under the Section 
on criteria* The data are recorded, however, for possible use at some other 
time* 



QUESTION 5* 

5a, How much do you know about your first choice occupation? 

k lot k medium amount Little or nothing 

5b* How have you gotten your Information? List ^11 the sources you have 
used, and tell how good each was as a source of Information, e*g., amount of 
information you obtained, haw unbiased and accurate It was, etc* 

Source Excellent Good So^So Poor 

People In the field 

Counselor , 



Reference Book 



Teacher 



Professional Org. 
Parent 



Friend or relative 



Other 
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Give two scores : Sa for amount of knowledge, and Sb for list of sources* 



5a. Response Score 

A lot +2 
A medium amount 

Little or nothing 0 

5b. Ho Response 0 

1-2 sources +1 

3 or more sources -f2 



No score will be higher than +2 for 5a or 5b. 

Note that the student^s evaluation of the sources (excellent, good, etc.) 
Is not scored. It Is Included for research purposes only. 

QUESTION 6 

6. What qualities are necessary or Important for being a 

Ask one a t a^ time : Which qualities do you possess? What evidence do 
you have? Which qualities do you lack? What evidence do you have? 

Important Qualities Possess Lack Evidence 



Give one point (-M) for each supported quality (whether student gives evidence that 
he possesses or lacks the quality). For example; "Possesses patience — I don't get 
angry when I baby sit"; or '*Do not possess artistic ability — I don't draw as well as 
my cousin.'* 

Some students will name skills as qualities. Give credit for specialized skills 
which will require special abilities to learn (e.g., math requires mathematical 
ability^ drawing requires artistic ability. Give credit If student gives evidence 
of the ability.) 
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QUESTION 6 (Continued) 



''Intelligence" ic given credit it evidence such as good grades is 
given for it, ''Knowledge" is given credit if evidence is given of 
ability to gain knowledge. 

No credit is given for "Typing" because it is a skill for which most 
people have a modicum of ability and therefore it is classified as a 
skill which is acquired. No credit is given for "Knowing what you 
are doing," ''interest," or "strong desire to do it" because these 
would be true for any occupation. 

The score for this question is the 3um of the points assigned. 
Scores for this question typically fall in the range of 0^4, 



QUESTION 7 



7. People change their occupational goals. Suppose a year from now 

I met you and you no longer expected to become a , 

List all the reasons why you might have changed your mind"or why people in 
general change their minds about their occupational choices, 

Financial problems 

Boy/girlfriend 

Family problems 



School performance 
New occupation info. 
Changes in values 



Other: 



Other: 



Response Score 

"Don't know" or weak answer such as 0 
"Finding something you like better" 
or "Finding something you didn't like 
about it," 

1-2 reasons +1 
3 or more reasons +2 
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Cautlon: Check financial problems only If student Indicates he could 
not afford to train for the career* "Low pay" belongs under **New Occupa- 
tional Information*" "Could not support family on pay" also belongs under 
"New Occupational Information," not under family problems* 

Scores for this auestion will be no higher than +2, 



QUESTION 8 



8, If for some reason yoii couldn't become a 



what would you do Instead? What other occupation would you choose? 

Compare your first and second choice occupation* Kow are they alike? 
How are they different? 

Alike: Different: 



Give one point (+1) for each construct mentioned, whether it is under 
"alike" or "different," but do not count any idea or construct more than once* 
For example: "Alike in that both Involve mechanical drawing," "Different in 
that an architect draws house plans, an aeronautical engineer draws designs 
for engines*" Count only one point for drawing* 

The score for this question is the sum of the points assigned* 

Scores typically range from 0-6* 



QUESTION 9 

9* What things do you like about the first that you would also find in 
the second? What things would you dislike in the second that you wouldn't 
find in the first? (If "none," ask: "Why would you choose 1 over 2?*') 

Like: 



Dislike ; 
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Give one point (+1) for each construct mentioned, whether It be under 
"Like" or "Dislike", but do not count any construct more than once. For 
example: "Like helping people" and "Would not like helping sick people as 
much <is helping children*" Count only one point for helping people. 

The score for this question is the sum of the points assigned* 

Scores for this question usually range from 0 to 5. 



QUESTION 10 

10* What do you expect to be doing In the next 2 years that will help 
prepare you to enter (occupational field)? 

What college courses, training, apprenticeships, work experience, or 
what program would allow you to plan for the first choice and still keep the 
second open? 



This question should produce a wide range of responses Indicating whether 
the student has done no planning at all, has a few vague plans In mind, or has 
carefully laid out plans. Including provisions for alternatives* Scoring will 
Involve Subjective judgment* 

Score Response 

0 "Don't know" or weak answer, such as "Wlll take 

tvplng In lOth grade — might be useful for a 
librarian; algebra, but I don*t know what It 
might do for you." (No mention of first career 
which was teaching the deaf*) 

+1 A general answer encompassing an alternate 

career, or for carefully detailed plans but only 
for one career (no second career named, or 
second career named but not planned for)* 

Example: "Get on team, and take auto mechanics 
In high school," (for coach and auto mechanic)* 
"Job with Red Cross* More work with Alcoholics 
Anonymous* Hotline or counseling* Psychology 
and philosophy," (good answer for social worker, 
no mention of second career, animal trainer)* 
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+2 A carefully laid out plan^ detailed and 

reasonable^ which Includes a second career. 

Example: "College — basic science and nur- 
slng»6 weeks practical experience In each 
area of nursing. Plan to take all psychology 
electlves and concentrate on psychiatric 
nursings Summer job If can/* (Covere both 
psychiatric nurse and child psychologist.) 

When second career Is closely related to 
first ^ student might appear to have an ad- 
vantage » but awareness of a closely related 
second choice may be assumed to be evidence 
of good planning^ 

Ho score will be higher than +2. 



QUESTION 11 

11« Where can someone who is interested in a particular occupation find 
information about it? 

(prompt: Where would you go for a description of the work activities? 
salaries? working hours? requirements for entry? your own qualifications? 
conditions of work? opportunities and outlook?) 

People in the field 

Counselor 

Reference Book 



Teacher 

Professional Org* 
Parent, relative, friend 
Other: 



Score Response 

0 Tlo idea* **l)on't know/* 

+1 1-2 ideas 

+2 3 or more ideas 



No score will be higher than +2. 
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QUESTION 12 

12 • Name some of the things you 
of the subjects you like In school, or 

Are there any other things which 
(Make sure this Is an Inclusive list, 
things relate to becoming a 

Interests : 



like to do out of school. Name some 
that you are good In. 

you do well that you haven't named? 
Then ask:) Now, let's see If these 
and If they do, how? 

Relationships : 



Score 0^ If no relationships can be seen, no matCer how many Interests may be 
named. 

Interests are to be related to the student's first choice occupation, and these 
relationships are written in the right hand column. A line Is drawn from each 
activity to each valid relationship. More than one activity might relate In 
the same way to the career goal. The score Is the total number of linking lines. 
(See example be lew.) 



Relationships 

learn to work with people 

see a hospital in action 

-> need to study more science later 
on to become a nurse 

Score +3, since three linking lines have been drawn. 

Scores usually range from 0 to 6. 



Example : (Career Goal — Nurse) 
Interests 
Candystrlper 
Plays piano 
Good In science 
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QUESTION 13 

13. What are some of the things people can do to better their chances 
of ending up In an occupation that they will like? 

get preparatory experience 

get required training/education 

learn about themselves 

learn about occupations 

ask someone*s opinion 
don*t know 

other : 

other : 



Score highest level response^ (Do not total responses*) 

Score Response 

0 "Don*t know." 

+1 "Ask someone *s opinion" or "Other" 

(Probe further when student answers 
"Ask someone's opinion*") 
Especially for 9th graders give +1 
for "Keeping an open mind*" 

+2 For any one or more of the first four 

answers * 

No score will be higher 
than +2. 
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QUESTION 14 

14. Have you done anything to Increase your chances of ending up in an 
occupation you will like? Yes No If yes, what? 

get previous experience 

get required training/education 

learn about myself 

learn about occupations 

ask someone *s opinion 

don ' t know 

other: 

other: 



Scoring Is exactly the same as for Question 13. 



QUESTION 15 

15* What are some of the characteristics of a good career decision- 
maker? 

Self -rating 

Characteristics Above Av» Av» Below Av. 



Compared to other students your age, rate yourself on each of these 
characteristics: (Above Average, Average, Below Average*) 

This question Is given two scores: 15a for the characteristics named; 
13b for Che student's racing of himself on each characteristic* 

15a; 

Score Response 

0 "Don*t know" or Inadequate answers, such as "Know 

what they want to do" (A good decision-maker might 
postpone a decision pending further Information*) 
'^Intelligence" (High Intelligence Is not necessary 
for good decision-making* It Is sufficient to 
recognize one*s own ability level*) 
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+1 Por each answer which suggests any of the follcn/lng: 

Information Seeking ("Talk to people about 

what*8 needed.") 
Planning ("Setting goals," "Getting education,") 
Keeping an Open Mind ("Be well-rounded.") 
Self-Awareness ("Knowing self, Interests, and 

abilities.") 
Personality Traits ("Self-confidence, deter- 
mination. Independence, Industrlousness* ") 

Give credit for an Idea only once, even though It may be stated twice or 
more. Total score = total number of Ideas mentioned. 

Scores are usually no higher than 4, 

15b: 

Score Response 

+1 Below Average 

+2 Average 

+3 Above Average 

The ratings for all characteristics are averaged to one decimal point 
(For example 2.5) 

The highest score would be 3,0. 
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QUESTION 16 



16; Throughout this Interview we have talked about you, your career 
choice, and the Important things that you expect from the work you enter* 
Thinking back over all you've said, answer the question, *'What would an 
Ideal occupation be like?" It doesn't have to be a real occupation, but It 
should Include all the satisfactions, all the things you would want from an 
occupation, If you could have everything you wanted* 



I. Intrinsic 



Prestige 

Independence 

Help 

Variety 

Leadershli;) 

Interest Field 



II. Extrinsic 

Income 

Leisure 

Fringe 

Outlook 

Advance 

Security 



III. Concomitant 
Surroundings 

Conditions 
Activities 

Location 



V. Other 1 



IV. Requirements 

Early Entry 

Ability 

Occ. Training 

Coll. Courses 

Pers. Qualifications 

Other Requirements 

Sex/Minority 



This question is scored in exactly the same way as Question 2. 
Scores usually range from 1 to 10- 



A FINAL NOTE 



The score for each question is entered on a score sheet* Scores 
are not summed across all questions. 
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WRITTEN QUESTIOKNAIKE 

Mark '^o Data'' if answer seems to be hasty, omitted, or given without 
thought. 

Part A: (See copy at end of this report.) 

Th^ answers for question 1-21 concern information about specific careers. 
These answers should be checked with the information on the career as given in 
SIGI occupational writeups. 

Question 1. Give +1 for each correct answer. Highest score will be +2. 

2* Give +1 if answer is correct overall. 

3. Give +1 for correct answer. 

4. Give +1 for each correct course listed. Highest score 
would be +3. 

5. Give +1 for each correct ability. Highest possible score 
would be +2. 

6-15. Give +1 for each question where appropriate response 

has been checked, 

16. Give +1 for each correct part. Highest score would be +4. 

17. Give +1 for correct answer. 

18. Give +1 for each correct part. Highest score would be +3. 
19-21. Give +1 for each question if answered correctly. 

Total all points given for questions 1 through 21 and enter on coding 
sheet. Highest possible total would be 29. Range was from 8-28. 

22. Give +1 for each construct mentioned. Highest score would 
be 3. 

Part Bt (See copy at end of this report.) 

1-6. Do not score. 

7. Give +5 for Very high 

+4 for fiood 

+3 for Average 

+2 for Below average 

+1 for Very low 

0 for No answer 

8-11. Give 0 for Never 

+1 for Sometimes 
+2 for Often 
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Add total points from 8-11 for score sheet* Highest possible score 
would be 8* 

12 -14* Give 0 for Agree 

+1 for Disagree 

15* Give +1 for Agree or Strongly Agree 
0 for Disagree 

16* Give 0 for Agree 

+1 for Disagree 

Add together total Points from 12 - 16 for score sheet* Highest score 
would be 5* 

17* Give 0 for Agree 

+1 for Disagree 

18 '-21. Give numerical figure to one decimal point for place student 

checked on scale (0-4.0)* 



REVIEW OF SCORING SCALES 

There are six scales for scoring, corresponding to the six criteria be- 
ing measured. They are: 

I^ Constructs : Questions 1, 2, 3, 8, 9, and 16 (plus 22 In part A 
of the written section) 

Information : Questions 5b and 11 (plus 1-21 In Part A) 

In Reality : Questions 6 and 12 

I^ Planning : Questions 7, 10, 13, and 14 (plus 17 and 8-11 In Part B 
of the written section) 

Ig Control: (Questions 12-16 In Part B of the written section.) 

I^ Questions 5a> i5s* and l5b (plus 7 and 18-21 on 

0 Awareness p^^^ ^ the written section) 



ERIC 



247 



-236- 
Table G 





Int ervlew 


Sco*re Means and 


Standard 


Deviations 








Grade 


9 


Grade 


12 






X 


S.D. 


X 


S.D. 




Con s t rue t s 


13.4 


5.2 


17.3 


4.8 




Information 




3.3 








Reality 


4.9 


2.4 


5.5 


2.8 




Planning 


8.9 


3.5 


11.5 


2.5 




Control 


3.1 


1.0 


3.5 


.9 




Avareness 


17.4 


3.8 


18.0 


5.4 



** p<.01 

Means and standard deviations for ninth and tvelfth grade samples on the 
six Interview measures are presented In Table G. Though the Interview has 
been revised since last Spring's field testing^ these findings parallel those 
found earlier. As before^ the mean scores fpr twelfth graders are higher 
on all measures with the difference between the groups reaching significance 
for Constructs^ Information and Planning. 



Table 4 

Inter correlations Among Interview Measures 
(Grades 9 & 12 Combined) 





Con. 


Inf or. 


Real. 


Plan. 


Cont. Awar. 


Constructs 


1 










Information 


.35 


1 








Reality 


.23 


.19 


1 






Planning 


.39 


.53 


.36 


1 




Control 


.18 


.29 


.17 


.32 


1 


Awareness 


.41 


.65 


.tfl 


.63 


.23 1 



In general^ the pattern of Inter correlation among the Interview measures 
(see Table 4) Is also similar to that obtained last Spring. The Awareness 
scale has a moderate to high correlation with the other scales; a low to 
moderate relationship exists among the Information^ Reality and Control scales. 
The relationship between Planning and Information provides the major exception 

to last Spring's findings. Four of the Items that were prev^ouRlv Included In 
the Information scale are currently Included In the Planning scale (Items 12*-16» 
Part B). This change In scoring » plus the addition of two new Items to the 
Planning scale probably account for the Increased relationship between the 
scales (from .33 to .53). 
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